00010000:00000010:1.1F:1715202783.948094:0:34:0:(ldlm_resource.c:1462:__ldlm_resource_free()) slab-freed '(res)': 232 at ffff88012a2f0b00. 00010000:00000010:1.1:1715202783.948108:0:34:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 560 at ffff88012c474240. 00010000:00000010:2.1F:1715202784.116747:0:27:0:(ldlm_resource.c:1462:__ldlm_resource_free()) slab-freed '(res)': 232 at ffff8800a8899000. 00010000:00000010:2.1:1715202784.116758:0:27:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 560 at ffff8800a7594240. 00010000:00000010:2.1:1715202784.119673:0:20:0:(ldlm_resource.c:1462:__ldlm_resource_free()) slab-freed '(res)': 232 at ffff88012c0ee000. 00010000:00000010:2.1:1715202784.119678:0:20:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 560 at ffff88012c83c000. 00010000:00000010:2.1:1715202784.119681:0:20:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 560 at ffff8800a3384900. 00010000:00080000:1.2F:1715202951.060655:0:0:0:(ldlm_lib.c:2909:target_recovery_expired()) lustre-MDT0000: recovery timed out; 0 clients are still in recovery after 60 seconds (0 clients connected) 00010000:00080000:3.2F:1715203029.060682:0:0:0:(ldlm_lib.c:2909:target_recovery_expired()) lustre-MDT0000: recovery timed out; 0 clients are still in recovery after 60 seconds (0 clients connected) 00010000:00010000:3.0:1715205774.299339:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050052f4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.299346:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050052f4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205774.299370:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xffd:0x0]: returning size 74834 00000004:00200000:3.0:1715205774.299372:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205774.299383:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050052f4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.299390:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050052f4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.299408:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af43050052ed lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xec5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22b74 expref: 105 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.299417:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050052f4 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22b74 expref: 104 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.299422:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xffd:0x0].0x0 (ffff8801336c2000) 00010000:00010000:3.0:1715205774.299424:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205774.299425:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73af600, rc 0) 00000100:00100000:3.0:1715205774.299446:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+104:11754:x1798520455694720:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1765us (1883us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.299451:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1421 00000100:00100000:3.0:1715205774.300609:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455694912 00000100:00100000:3.0:1715205774.300649:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 367 00000100:00100000:3.0:1715205774.300652:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+104:11754:x1798520455694912:12345-192.168.204.8@tcp:35:dbench.0 00000100:00100000:3.0:1715205774.300791:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+105:11754:x1798520455694912:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 137us (229us total) trans 330712482376 rc 0/0 00000100:00100000:3.0:1715205774.300798:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 367 00000100:00100000:3.0:1715205774.301961:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455695040 00000100:00100000:3.0:1715205774.301993:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1422 00000100:00100000:3.0:1715205774.301997:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c0e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+105:11754:x1798520455695040:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.302009:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.302020:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af43050052fb lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xec5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22b7b expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.302069:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305005302 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.302079:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050052f4 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22b74 expref: 106 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.302084:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305005302 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.302104:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050052f4 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22b74 expref: 106 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.302113:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050052f4 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22b74 expref: 106 pid: 14860 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.302122:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099e6e880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456017792:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205774.302156:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31a80 going to sleep for 6 seconds 00000100:00100000:3.0:1715205774.302947:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099e6e880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456017792:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205774.302960:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305005302 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205774.306504:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455695232 00010000:00010000:3.0:1715205774.306517:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305005302 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22b7b expref: 108 pid: 14860 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.306538:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4530 00000100:00100000:3.0:1715205774.306541:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c1c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+108:1830:x1798520455695232:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205774.306547:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205774.306550:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305005302 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22b7b expref: 108 pid: 14860 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.306556:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305005302 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22b7b expref: 108 pid: 14860 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.306565:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305005302 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22b7b expref: 108 pid: 14860 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.306574:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xffd:0x0].0x0 (ffff8801336c2000) 00010000:00010000:3.0:1715205774.306576:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1440/0xb608af4305005317 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.306581:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1440/0xb608af4305005317 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.306585:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1440/0xb608af4305005317 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.306595:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205774.306633:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c1c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+107:1830:x1798520455695232:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 92us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.306639:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4530 00010000:00010000:3.0:1715205774.309013:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1d40/0xb608af430500531e lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.309021:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1d40/0xb608af430500531e lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.309046:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1d40/0xb608af430500531e lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.309051:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c1d40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.309053:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1d40/0xb608af430500531e lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.309058:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1d40/0xb608af430500531e lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.309065:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xffd:0x0].0x0 (ffff8801336c2000) 00010000:00010000:3.0:1715205774.309067:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.309068:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1d40/0xb608af430500531e lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.309072:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1d40/0xb608af430500531e lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205774.316218:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.317169:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.319497:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1715205774.323544:0:11161:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715205774.323551:0:11161:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d221c0/0xb608af4305005387 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xfff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.323560:0:11161:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099d221c0 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:3.0:1715205774.323563:0:11161:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d221c0/0xb608af4305005387 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xfff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.323569:0:11161:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d221c0/0xb608af4305005387 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xfff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.323581:0:11161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xfff:0x0].0x0 (ffff880135bf2300) 00010000:00010000:3.0:1715205774.323583:0:11161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715205774.323586:0:11161:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d221c0/0xb608af4305005387 lrc: 1/0,0 mode: --/PW res: [0x20001b1b3:0xfff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.323590:0:11161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d221c0/0xb608af4305005387 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xfff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.323602:0:11161:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715205774.323603:0:11161:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715205774.323605:0:11161:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715205774.327065:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.328362:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455696512 00010000:00010000:3.0:1715205774.328469:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d23a80/0xb608af43050053a3 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22ba5 expref: 113 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.328496:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4531 00000100:00100000:3.0:1715205774.328500:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a17776c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+113:1831:x1798520455696512:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1715205774.328510:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205774.328512:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099d23a80/0xb608af43050053a3 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22ba5 expref: 113 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.328519:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099d23a80/0xb608af43050053a3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22ba5 expref: 113 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.328530:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d23a80/0xb608af43050053a3 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22ba5 expref: 113 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.328539:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xffd:0x0].0x0 (ffff8801336c2000) 00010000:00010000:3.0:1715205774.328541:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22880/0xb608af43050053b1 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.328546:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22880/0xb608af43050053b1 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.328551:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22880/0xb608af43050053b1 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.328585:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205774.328607:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a17776c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+112:1831:x1798520455696512:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 107us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.328612:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4531 00000100:00100000:3.0:1715205774.331641:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455696640 00010000:00010000:3.0:1715205774.331654:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22880/0xb608af43050053b1 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22bac expref: 114 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.331673:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4532 00000100:00100000:3.0:1715205774.331677:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1774740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+114:1830:x1798520455696640:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1715205774.331682:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205774.331684:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22880/0xb608af43050053b1 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22bac expref: 114 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.331689:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22880/0xb608af43050053b1 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22bac expref: 114 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.331700:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22880/0xb608af43050053b1 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22bac expref: 114 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.331709:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xffd:0x0].0x0 (ffff8801336c2000) 00010000:00010000:3.0:1715205774.331712:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22d00/0xb608af43050053c6 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.331718:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22d00/0xb608af43050053c6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.331724:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22d00/0xb608af43050053c6 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.331742:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205774.331767:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1774740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+113:1830:x1798520455696640:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 89us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.331784:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4532 00000100:00100000:3.0:1715205774.332998:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455696768 00000100:00100000:3.0:1715205774.333023:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 371 00000100:00100000:3.0:1715205774.333026:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009274d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+112:11754:x1798520455696768:12345-192.168.204.8@tcp:35:dbench.0 00000100:00100000:3.0:1715205774.333180:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009274d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+113:11754:x1798520455696768:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 152us (236us total) trans 330712482385 rc 0/0 00000100:00100000:3.0:1715205774.333186:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 371 00000100:00100000:3.0:1715205774.334083:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.338119:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455696960 00000100:00100000:3.0:1715205774.338145:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 372 00000100:00100000:3.0:1715205774.338148:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+114:11754:x1798520455696960:12345-192.168.204.8@tcp:37:dbench.0 00000100:00100000:3.0:1715205774.349504:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.354546:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.360980:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.363096:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455697920 00010000:00010000:3.0:1715205774.363110:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8c1d40/0xb608af4305005491 lrc: 4/0,0 mode: PR/PR res: [0x15d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22bf9 expref: 42 pid: 19955 timeout: 3134 lvb_type: 1 00000100:00100000:3.0:1715205774.363127:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4533 00000100:00100000:3.0:1715205774.363131:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb1300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+42:1830:x1798520455697920:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1715205774.363138:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205774.363148:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b8c1d40/0xb608af4305005491 lrc: 4/0,0 mode: PR/PR res: [0x15d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22bf9 expref: 42 pid: 19955 timeout: 3134 lvb_type: 1 00010000:00010000:3.0:1715205774.363156:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b8c1d40/0xb608af4305005491 lrc: 3/0,0 mode: PR/PR res: [0x15d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22bf9 expref: 42 pid: 19955 timeout: 3134 lvb_type: 1 00010000:00010000:3.0:1715205774.363170:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b8c1d40/0xb608af4305005491 lrc: 0/0,0 mode: --/PR res: [0x15d1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22bf9 expref: 42 pid: 19955 timeout: 3134 lvb_type: 1 00010000:00010000:3.0:1715205774.363199:0:6662:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205774.363201:0:6662:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205774.363205:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b8c2400/0xb608af4305005498 lrc: 2/0,0 mode: PW/PW res: [0x15d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c00 expref: 41 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.363215:0:6662:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8c2400/0xb608af4305005498 lrc: 3/0,0 mode: PW/PW res: [0x15d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c00 expref: 41 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.363235:0:6662:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b8c2400/0xb608af4305005498 lrc: 3/0,0 mode: PW/PW res: [0x15d1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c00 expref: 41 pid: 19955 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205774.363246:0:6662:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099e6cc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6662:1798520456018112:192.168.204.8@tcp:105: 00000100:00100000:3.0:1715205774.363277:0:6662:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31a80 going to sleep for 6 seconds 00000100:00100000:3.0:1715205774.363971:0:6662:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099e6cc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6662:1798520456018112:192.168.204.8@tcp:105: 00010000:00010000:3.0:1715205774.363981:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205774.363998:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb1300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+41:1830:x1798520455697920:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 867us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.364004:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4533 00000100:00100000:3.0:1715205774.367781:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455698240 00010000:00010000:3.0:1715205774.367801:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af430500548a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22bf2 expref: 118 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.367828:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4534 00000100:00100000:3.0:1715205774.367832:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092748e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+118:1831:x1798520455698240:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205774.367839:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205774.367843:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af430500548a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22bf2 expref: 118 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.367851:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af430500548a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22bf2 expref: 118 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.367865:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af430500548a lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22bf2 expref: 118 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.367885:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1000:0x0].0x0 (ffff88012bf50300) 00010000:00010000:3.0:1715205774.367888:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050054a6 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.367895:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050054a6 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.367901:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050054a6 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.367920:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205774.367948:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092748e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+117:1831:x1798520455698240:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 116us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.367954:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4534 00000100:00100000:3.0:1715205774.370039:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455698368 00010000:00010000:3.0:1715205774.370058:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050054a6 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c07 expref: 119 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.370083:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4535 00000100:00100000:3.0:1715205774.370087:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7078050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+119:1830:x1798520455698368:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1715205774.370100:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205774.370104:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050054a6 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c07 expref: 119 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.370112:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050054a6 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c07 expref: 119 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.370125:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050054a6 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c07 expref: 119 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.370134:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1000:0x0].0x0 (ffff88012bf50300) 00010000:00010000:3.0:1715205774.370136:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595d40/0xb608af43050054bb lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.370143:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595d40/0xb608af43050054bb lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.370149:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595d40/0xb608af43050054bb lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.370171:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205774.370192:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7078050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+118:1830:x1798520455698368:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 104us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.370197:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4535 00000100:00100000:3.0:1715205774.371762:0:7106:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455698432 00002000:00100000:3.0:1715205774.371794:0:7106:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x15d1:0x0] (0->77075) req@ffff88009274af80 x1798520455698432/t0(0) o4->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 488/0 e 0 to 0 dl 1715205780 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dbench.0' 00002000:00100000:3.0:1715205774.371802:0:7106:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req ffff88009274af80 with x1798520455698432 ext(0->77075) 00002000:00010000:3.0:1715205774.371805:0:7106:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009274af80 00000100:00100000:3.0:1715205774.371823:0:7106:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 735 00000100:00100000:3.0:1715205774.371827:0:7106:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009274af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+41:1831:x1798520455698432:12345-192.168.204.8@tcp:4:dbench.0 00000100:00100000:3.0:1715205774.373456:0:7106:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009274af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+43:1831:x1798520455698432:12345-192.168.204.8@tcp:4:dbench.0 Request processed in 1626us (1736us total) trans 4294970680 rc 0/0 00000100:00100000:3.0:1715205774.373463:0:7106:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 735 00002000:00100000:3.0:1715205774.373469:0:7106:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x15d1:0x0] (0->77075) req@ffff88009274af80 x1798520455698432/t4294970680(0) o4->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 488/448 e 0 to 0 dl 1715205780 ref 1 fl Complete:/0/0 rc 0/0 job:'dbench.0' 00002000:00100000:3.0:1715205774.373476:0:7106:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req ffff88009274af80 with x1798520455698432 ext(0->77075) 00002000:00010000:3.0:1715205774.373479:0:7106:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009274af80 00000100:00100000:3.0:1715205774.409334:0:7106:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455698944 00002000:00100000:3.0:1715205774.409353:0:7106:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x15d1:0x0] (0->4095) req@ffff88009274aac0 x1798520455698944/t0(0) o4->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 4584/0 e 0 to 0 dl 1715205780 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dbench.0' 00002000:00100000:3.0:1715205774.409361:0:7106:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req ffff88009274aac0 with x1798520455698944 ext(0->4095) 00002000:00010000:3.0:1715205774.409364:0:7106:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009274aac0 00000100:00100000:3.0:1715205774.409376:0:7106:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 736 00000100:00100000:3.0:1715205774.409380:0:7106:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009274aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+40:1830:x1798520455698944:12345-192.168.204.8@tcp:4:dbench.0 00000100:00100000:3.0:1715205774.409611:0:7106:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009274aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+42:1830:x1798520455698944:12345-192.168.204.8@tcp:4:dbench.0 Request processed in 230us (326us total) trans 4294970682 rc 0/0 00000100:00100000:3.0:1715205774.409633:0:7106:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 736 00002000:00100000:3.0:1715205774.409638:0:7106:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x100010000:0x15d1:0x0] (0->4095) req@ffff88009274aac0 x1798520455698944/t4294970682(0) o4->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 4584/448 e 0 to 0 dl 1715205780 ref 1 fl Complete:/0/0 rc 0/0 job:'dbench.0' 00002000:00100000:3.0:1715205774.409645:0:7106:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req ffff88009274aac0 with x1798520455698944 ext(0->4095) 00002000:00010000:3.0:1715205774.409647:0:7106:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009274aac0 00000100:00100000:3.0:1715205774.429355:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455699392 00000100:00100000:3.0:1715205774.429371:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1449 00000100:00100000:3.0:1715205774.429375:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+87:11754:x1798520455699392:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.429381:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.429387:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af43050054ec lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xec5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22c1c expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.429421:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050054f3 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.429429:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595d40/0xb608af43050054e5 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c15 expref: 88 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.429434:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050054f3 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.429456:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595d40/0xb608af43050054e5 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c15 expref: 88 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.429465:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595d40/0xb608af43050054e5 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c15 expref: 88 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.429474:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099e6cc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456018304:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205774.429511:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f2c00 going to sleep for 6 seconds 00000100:00100000:3.0:1715205774.430722:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099e6cc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456018304:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205774.430735:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050054f3 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205774.430930:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455699456 00010000:00010000:3.0:1715205774.430945:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595d40/0xb608af43050054e5 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c15 expref: 89 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.430970:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4536 00000100:00100000:3.0:1715205774.430975:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb2600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+89:1830:x1798520455699456:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1715205774.430982:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205774.430985:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595d40/0xb608af43050054e5 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c15 expref: 89 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.430991:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595d40/0xb608af43050054e5 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c15 expref: 89 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.431002:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595d40/0xb608af43050054e5 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c15 expref: 89 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.431012:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1000:0x0].0x0 (ffff88012bf50300) 00010000:00010000:3.0:1715205774.431014:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050054f3 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.431020:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050054f3 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.431024:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050054f3 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.431036:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205774.431069:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb2600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+88:1830:x1798520455699456:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 93us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.431074:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4536 00000100:00100000:3.0:1715205774.432131:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.433676:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.435105:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.436478:0:19955:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455699776 00000100:00100000:3.0:1715205774.436508:0:19955:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14624 00000100:00100000:3.0:1715205774.436511:0:19955:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b2f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+39:1830:x1798520455699776:12345-192.168.204.8@tcp:2:dbench.0 00002000:00010000:3.0:1715205774.436663:0:19955:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x15d1:0x0] updating lvb size from disk: 77076 -> 77076 00002000:00010000:3.0:1715205774.436665:0:19955:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x15d1:0x0] updating lvb mtime from disk: 1715205763 -> 1715205763 00002000:00010000:3.0:1715205774.436666:0:19955:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x15d1:0x0] updating lvb atime from disk: 1715205765 -> 1715205755 00002000:00010000:3.0:1715205774.436667:0:19955:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x15d1:0x0] updating lvb ctime from disk: 1715205775 -> 1715205775 00002000:00010000:3.0:1715205774.436668:0:19955:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x15d1:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:3.0:1715205774.436700:0:19955:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b2f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+40:1830:x1798520455699776:12345-192.168.204.8@tcp:2:dbench.0 Request processed in 185us (339us total) trans 4294970683 rc 0/0 00000100:00100000:3.0:1715205774.436705:0:19955:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14624 00000100:00100000:3.0:1715205774.450741:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455700544 00010000:00010000:3.0:1715205774.450762:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7597a80/0xb608af430500556a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c3f expref: 94 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.450805:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4540 00000100:00100000:3.0:1715205774.450809:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+94:1831:x1798520455700544:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1715205774.450820:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205774.450823:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7597a80/0xb608af430500556a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c3f expref: 94 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.450835:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7597a80/0xb608af430500556a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c3f expref: 94 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.450849:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7597a80/0xb608af430500556a lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c3f expref: 94 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.450868:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xffd:0x0].0x0 (ffff88012cbdc500) 00010000:00010000:3.0:1715205774.450871:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594fc0/0xb608af4305005578 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.450877:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594fc0/0xb608af4305005578 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.450883:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594fc0/0xb608af4305005578 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.450928:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205774.451183:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+93:1831:x1798520455700544:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 373us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.451189:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4540 00000100:00100000:3.0:1715205774.453606:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455700672 00010000:00010000:3.0:1715205774.453637:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594fc0/0xb608af4305005578 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c46 expref: 95 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.453658:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4541 00000100:00100000:3.0:1715205774.453660:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c76c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+95:1830:x1798520455700672:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205774.453666:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205774.453668:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594fc0/0xb608af4305005578 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c46 expref: 95 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.453673:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594fc0/0xb608af4305005578 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c46 expref: 95 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.453681:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594fc0/0xb608af4305005578 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c46 expref: 95 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.453688:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xffd:0x0].0x0 (ffff88012cbdc500) 00010000:00010000:3.0:1715205774.453690:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75958c0/0xb608af430500558d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.453694:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75958c0/0xb608af430500558d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.453697:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75958c0/0xb608af430500558d lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xffd:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.453709:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205774.453739:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c76c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+94:1830:x1798520455700672:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 76us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.453744:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4541 00000100:00100000:3.0:1715205774.461871:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455701120 00010000:00010000:3.0:1715205774.461900:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26640/0xb608af4305001950 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21a4f expref: 96 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.461933:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4542 00000100:00100000:3.0:1715205774.461938:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7057850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+96:1831:x1798520455701120:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1715205774.461950:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205774.461954:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26640/0xb608af4305001950 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21a4f expref: 96 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.461962:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26640/0xb608af4305001950 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21a4f expref: 96 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.461977:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26640/0xb608af4305001950 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21a4f expref: 96 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.461987:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef7:0x0].0x0 (ffff88012c0eee00) 00010000:00010000:3.0:1715205774.461991:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595d40/0xb608af43050055b7 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.461998:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595d40/0xb608af43050055b7 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.462004:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595d40/0xb608af43050055b7 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.462026:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205774.462066:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7057850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+95:1831:x1798520455701120:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 127us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.462072:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4542 00000100:00100000:3.0:1715205774.465226:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455701248 00010000:00010000:3.0:1715205774.465251:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595d40/0xb608af43050055b7 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c54 expref: 97 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.465286:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4543 00000100:00100000:3.0:1715205774.465291:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+97:1830:x1798520455701248:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1715205774.465301:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205774.465304:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595d40/0xb608af43050055b7 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c54 expref: 97 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.465313:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595d40/0xb608af43050055b7 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c54 expref: 97 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.465328:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595d40/0xb608af43050055b7 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c54 expref: 97 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.465340:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef7:0x0].0x0 (ffff88012c0eee00) 00010000:00010000:3.0:1715205774.465343:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594480/0xb608af43050055cc lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.465349:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594480/0xb608af43050055cc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.465354:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594480/0xb608af43050055cc lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.465385:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205774.465424:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+96:1830:x1798520455701248:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 132us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.465431:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4543 00000100:00100000:3.0:1715205774.469320:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455701440 00010000:00010000:3.0:1715205774.469334:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26400/0xb608af4305001973 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21a5d expref: 97 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.469362:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4544 00000100:00100000:3.0:1715205774.469366:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb3900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+97:1831:x1798520455701440:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1715205774.469372:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205774.469375:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26400/0xb608af4305001973 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21a5d expref: 97 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.469382:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26400/0xb608af4305001973 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21a5d expref: 97 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.469393:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26400/0xb608af4305001973 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21a5d expref: 97 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.469402:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef8:0x0].0x0 (ffff880091e4c900) 00010000:00010000:3.0:1715205774.469433:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af43050055da lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.469439:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af43050055da lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.469443:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af43050055da lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.469456:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205774.469484:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb3900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+96:1831:x1798520455701440:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 118us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.469490:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4544 00000100:00100000:3.0:1715205774.472880:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455701568 00010000:00010000:3.0:1715205774.472895:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af43050055da lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c62 expref: 98 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.472917:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4545 00000100:00100000:3.0:1715205774.472921:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb2140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+98:1830:x1798520455701568:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205774.472927:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205774.472930:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af43050055da lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c62 expref: 98 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.472937:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af43050055da lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c62 expref: 98 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.472947:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af43050055da lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c62 expref: 98 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.472955:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef8:0x0].0x0 (ffff880091e4c900) 00010000:00010000:3.0:1715205774.472957:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050055ef lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.472962:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050055ef lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.472967:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050055ef lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.472977:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205774.473001:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb2140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+97:1830:x1798520455701568:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 79us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.473006:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4545 00000100:00100000:3.0:1715205774.478248:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455701760 00010000:00010000:3.0:1715205774.478265:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009af258c0/0xb608af4305001996 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21a6b expref: 98 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.478292:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4546 00000100:00100000:3.0:1715205774.478296:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb76c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+98:1830:x1798520455701760:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1715205774.478305:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205774.478308:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009af258c0/0xb608af4305001996 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21a6b expref: 98 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.478316:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009af258c0/0xb608af4305001996 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21a6b expref: 98 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.478328:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009af258c0/0xb608af4305001996 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21a6b expref: 98 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.478337:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef9:0x0].0x0 (ffff88009bcc4a00) 00010000:00010000:3.0:1715205774.478340:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af43050055fd lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xef9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.478346:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af43050055fd lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xef9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.478350:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af43050055fd lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xef9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.478362:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205774.478394:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb76c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+97:1830:x1798520455701760:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 97us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.478403:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4546 00000100:00100000:3.0:1715205774.480645:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455701888 00010000:00010000:3.0:1715205774.480659:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af43050055fd lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c70 expref: 99 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.480687:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4547 00000100:00100000:3.0:1715205774.480690:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+99:1830:x1798520455701888:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1715205774.480697:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205774.480701:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af43050055fd lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c70 expref: 99 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.480708:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af43050055fd lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xef9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c70 expref: 99 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.480718:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af43050055fd lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xef9:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c70 expref: 99 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.480726:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef9:0x0].0x0 (ffff88009bcc4a00) 00010000:00010000:3.0:1715205774.480728:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305005612 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef9:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.480734:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305005612 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.480739:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305005612 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xef9:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.480750:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205774.480783:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+98:1830:x1798520455701888:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 92us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.480789:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4547 00000100:00100000:3.0:1715205774.489602:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.494314:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.496173:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.497753:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455702336 00000100:00100000:3.0:1715205774.497801:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1470 00000100:00100000:3.0:1715205774.497805:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+98:11754:x1798520455702336:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.497814:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.497822:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305005674 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22ca1 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.497848:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af430500567b lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.497855:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af430500567b lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.497862:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af430500567b lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.497872:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af4305005682 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x37eb7f65 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.497877:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af4305005682 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.497882:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af4305005682 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.498046:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad680/0xb608af4305005689 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xebf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.498051:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad680/0xb608af4305005689 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebf:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.498054:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad680/0xb608af4305005689 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebf:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205774.498071:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xebf:0x0]: returning size 260096 00000004:00200000:3.0:1715205774.498073:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205774.498083:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad680/0xb608af4305005689 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebf:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.498089:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad680/0xb608af4305005689 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.498093:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af430500567b lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.498095:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af430500567b lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.498098:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af430500567b lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.498101:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73acfc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.498102:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af430500567b lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.498108:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af430500567b lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.498112:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:3.0:1715205774.498113:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.498114:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af430500567b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.498117:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af430500567b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.498127:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af4305005682 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.498130:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af4305005682 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.498133:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af4305005682 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.498136:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73adf80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.498137:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af4305005682 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.498142:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af4305005682 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.498146:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x37eb7f65 (ffff880092bfc400) 00010000:00010000:3.0:1715205774.498148:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.498150:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af4305005682 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.498154:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af4305005682 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.498173:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305005674 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22ca1 expref: 100 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.498183:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad680/0xb608af4305005689 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22ca1 expref: 99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.498188:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebf:0x0].0x0 (ffff880092bfc300) 00010000:00010000:3.0:1715205774.498190:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205774.498191:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ad680, rc 0) 00000100:00100000:3.0:1715205774.498226:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+99:11754:x1798520455702336:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 421us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.498232:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1470 00000100:00100000:3.0:1715205774.499407:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.504944:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455702720 00000100:00100000:3.0:1715205774.504971:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1474 00000100:00100000:3.0:1715205774.504975:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+103:11754:x1798520455702720:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.504985:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.504992:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050056dd lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22cbd expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.505015:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af43050056e4 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.505025:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af43050056e4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.505031:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af43050056e4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205774.505044:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205774.505050:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af43050056e4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.505056:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af43050056e4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.505066:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050056dd lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22cbd expref: 104 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.505078:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af43050056e4 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22cbd expref: 103 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.505083:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1001:0x0].0x0 (ffff88012cbdc900) 00010000:00010000:3.0:1715205774.505084:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205774.505085:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ac000, rc 0) 00000100:00100000:3.0:1715205774.505115:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+103:11754:x1798520455702720:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 139us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.505119:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1474 00000100:00100000:3.0:1715205774.506031:0:19955:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455702784 00000100:00100000:3.0:1715205774.506058:0:19955:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14625 00000100:00100000:3.0:1715205774.506063:0:19955:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb5580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+39:1831:x1798520455702784:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.506070:0:19955:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.506082:0:19955:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a73adb00/0xb608af43050056eb lrc: 2/0,0 mode: --/PR res: [0x17b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22cc4 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1715205774.506097:0:19955:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x17b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1715205774.506108:0:19955:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205774.506109:0:19955:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205774.506114:0:19955:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a73adb00/0xb608af43050056eb lrc: 3/0,0 mode: PR/PR res: [0x17b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22cc4 expref: 40 pid: 19955 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715205774.506123:0:19955:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a73adb00/0xb608af43050056eb lrc: 3/0,0 mode: PR/PR res: [0x17b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22cc4 expref: 40 pid: 19955 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715205774.506130:0:19955:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73adb00, rc 0) 00000100:00100000:3.0:1715205774.506161:0:19955:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb5580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+40:1831:x1798520455702784:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 98us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.506166:0:19955:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14625 00000100:00100000:3.0:1715205774.507264:0:19955:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455702848 00000100:00100000:3.0:1715205774.507278:0:19955:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14626 00000100:00100000:3.0:1715205774.507281:0:19955:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b04c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+40:11754:x1798520455702848:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.507286:0:19955:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.507291:0:19955:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a73aed00/0xb608af43050056f2 lrc: 2/0,0 mode: --/PW res: [0x17b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22ccb expref: -99 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.507301:0:19955:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a73adb00/0xb608af43050056eb lrc: 2/0,0 mode: PR/PR res: [0x17b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22cc4 expref: 41 pid: 19955 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715205774.507309:0:19955:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205774.507310:0:19955:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205774.507311:0:19955:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a73aed00/0xb608af43050056f2 lrc: 4/0,0 mode: --/PW res: [0x17b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22ccb expref: 41 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.507327:0:19955:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a73adb00/0xb608af43050056eb lrc: 3/0,0 mode: PR/PR res: [0x17b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22cc4 expref: 41 pid: 19955 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715205774.507333:0:19955:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a73adb00/0xb608af43050056eb lrc: 4/0,0 mode: PR/PR res: [0x17b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22cc4 expref: 41 pid: 19955 timeout: 3134 lvb_type: 1 00000100:00100000:3.0:1715205774.507340:0:19955:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099e69300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19955:1798520456019072:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205774.507378:0:19955:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f29c0 going to sleep for 6 seconds 00000100:00100000:3.0:1715205774.508309:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455702912 00010000:00010000:3.0:1715205774.508325:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a73adb00/0xb608af43050056eb lrc: 4/0,0 mode: PR/PR res: [0x17b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22cc4 expref: 41 pid: 19955 timeout: 3134 lvb_type: 1 00000100:00100000:3.0:1715205774.508343:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4548 00000100:00100000:3.0:1715205774.508346:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a482f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+41:1830:x1798520455702912:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1715205774.508353:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205774.508362:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a73adb00/0xb608af43050056eb lrc: 4/0,0 mode: PR/PR res: [0x17b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22cc4 expref: 41 pid: 19955 timeout: 3134 lvb_type: 1 00010000:00010000:3.0:1715205774.508371:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a73adb00/0xb608af43050056eb lrc: 3/0,0 mode: PR/PR res: [0x17b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22cc4 expref: 41 pid: 19955 timeout: 3134 lvb_type: 1 00010000:00010000:3.0:1715205774.508428:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a73adb00/0xb608af43050056eb lrc: 0/0,0 mode: --/PR res: [0x17b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22cc4 expref: 41 pid: 19955 timeout: 3134 lvb_type: 1 00010000:00010000:3.0:1715205774.508436:0:6662:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205774.508437:0:6662:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205774.508512:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a73aed00/0xb608af43050056f2 lrc: 2/0,0 mode: PW/PW res: [0x17b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22ccb expref: 40 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.508518:0:6662:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a73aed00/0xb608af43050056f2 lrc: 3/0,0 mode: PW/PW res: [0x17b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22ccb expref: 40 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.508534:0:6662:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a73aed00/0xb608af43050056f2 lrc: 3/0,0 mode: PW/PW res: [0x17b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22ccb expref: 40 pid: 19955 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205774.508541:0:6662:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099e6da40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6662:1798520456019136:192.168.204.8@tcp:105: 00000100:00100000:3.0:1715205774.508571:0:6662:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f2d80 going to sleep for 6 seconds 00000020:00000080:3.0:1715205774.510358:0:16950:0:(class_obd.c:310:class_handle_ioctl()) cmd = c008667f 00000020:00000080:3.0:1715205774.510364:0:16950:0:(class_obd.c:134:class_resolve_dev_name()) device name lustre-MDT0000 00000020:00000080:3.0:1715205774.510368:0:16950:0:(class_obd.c:141:class_resolve_dev_name()) device name lustre-MDT0000, dev 5 00000100:00100000:3.0:1715205774.511698:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455703104 00000100:00100000:3.0:1715205774.511730:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1475 00000100:00100000:3.0:1715205774.511733:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a486880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+104:11754:x1798520455703104:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.511749:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.511762:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050056f9 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22cd2 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.511815:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005700 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.511826:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005700 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.511835:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005700 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.511845:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305005707 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x44a29697 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.511850:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305005707 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.511855:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305005707 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.511910:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005700 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.511914:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005700 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.511917:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005700 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.511920:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73aeac0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.511922:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005700 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.511925:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005700 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.511931:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:3.0:1715205774.511933:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.511935:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005700 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.511937:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005700 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.511944:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305005707 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.511947:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305005707 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.511949:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305005707 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.511951:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73aef40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.511952:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305005707 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.511954:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305005707 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.511957:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x44a29697 (ffff88009bd5a500) 00010000:00010000:3.0:1715205774.511958:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.511958:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305005707 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.511964:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305005707 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.511990:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050056f9 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22cd2 expref: 105 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.511994:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050056f9 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22cd2 expref: 105 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.512000:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ad8c0, rc 0) 00010000:00000080:3.0:1715205774.512003:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009a486880 x1798520455703104/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 576/640 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.512050:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a486880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+104:11754:x1798520455703104:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 316us (380us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205774.512057:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1475 00000100:00100000:3.0:1715205774.513076:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455703168 00000100:00100000:3.0:1715205774.513106:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1476 00000100:00100000:3.0:1715205774.513111:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+104:11754:x1798520455703168:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.513119:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.513127:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500570e lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22cd9 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.513146:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500570e lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22cd9 expref: 105 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.513154:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500570e lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22cd9 expref: 105 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.513160:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:3.0:1715205774.513161:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.513163:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73af180, rc 0) 00010000:00000080:3.0:1715205774.513165:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb04c0 x1798520455703168/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 328/344 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.513193:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+105:11754:x1798520455703168:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 82us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.513203:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1476 00000100:00100000:3.0:1715205774.519670:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.521677:0:14225:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099e6da40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14225:1798520456019200:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1715205774.521720:0:14225:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715205774.521746:0:14225:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f2480 going to sleep for 6 seconds 00000100:00100000:3.0:1715205774.525138:0:14225:0:(client.c:2892:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294970671 gen 2 00000004:00080000:3.0:1715205774.525144:0:14225:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a6dec740, transno 4294970654 00000004:00080000:3.0:1715205774.525152:0:14225:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a6deb900, transno 4294970655 00000004:00080000:3.0:1715205774.525155:0:14225:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a6deb440, transno 4294970656 00000004:00080000:3.0:1715205774.525156:0:14225:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a6deaf80, transno 4294970657 00000004:00080000:3.0:1715205774.525158:0:14225:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a6debdc0, transno 4294970658 00000004:00080000:3.0:1715205774.525160:0:14225:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a6dec280, transno 4294970659 00000004:00080000:3.0:1715205774.525162:0:14225:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a6deaac0, transno 4294970660 00000004:00080000:3.0:1715205774.525164:0:14225:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a6decc00, transno 4294970661 00000004:00080000:3.0:1715205774.525166:0:14225:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88009edb2ac0, transno 4294970662 00000004:00080000:3.0:1715205774.525168:0:14225:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a1773440, transno 4294970663 00000004:00080000:3.0:1715205774.525170:0:14225:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88009edb5a40, transno 4294970664 00000004:00080000:3.0:1715205774.525172:0:14225:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a1772600, transno 4294970665 00000004:00080000:3.0:1715205774.525174:0:14225:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a1772f80, transno 4294970666 00000004:00080000:3.0:1715205774.525177:0:14225:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88009edb50c0, transno 4294970667 00000004:00080000:3.0:1715205774.525179:0:14225:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a1772ac0, transno 4294970668 00000004:00080000:3.0:1715205774.525182:0:14225:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88009edb4280, transno 4294970669 00000004:00080000:3.0:1715205774.525184:0:14225:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff880099e6b900, transno 4294970670 00000004:00080000:3.0:1715205774.525187:0:14225:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff880099e6b440, transno 4294970671 00000100:00100000:3.0:1715205774.525193:0:14225:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099e6da40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14225:1798520456019200:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1715205774.525203:0:14225:0:(osp_precreate.c:722:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x100010000:0x15d2:0x0]-[0x100010000:0x1601:0x0] 00000100:00100000:3.0:1715205774.531245:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.536064:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.553583:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.553606:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455704896 00000100:00100000:3.0:1715205774.553647:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1485 00000100:00100000:3.0:1715205774.553651:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e6b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+113:11754:x1798520455704896:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.553662:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.553671:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050057c4 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22d18 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.553711:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af43050057cb lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.553720:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af43050057cb lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.553727:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af43050057cb lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.553736:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af43050057d2 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x68e4194e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.553745:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af43050057d2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.553749:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af43050057d2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.553805:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af43050057cb lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.553810:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af43050057cb lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.553814:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af43050057cb lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.553819:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73aef40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.553821:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af43050057cb lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.553826:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af43050057cb lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.553832:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:3.0:1715205774.553834:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.553836:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af43050057cb lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.553840:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af43050057cb lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.553851:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af43050057d2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.553856:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af43050057d2 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.553860:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af43050057d2 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.553864:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73aeac0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.553865:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af43050057d2 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.553870:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af43050057d2 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.553875:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x68e4194e (ffff88008f030200) 00010000:00010000:3.0:1715205774.553876:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.553877:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af43050057d2 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.553881:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af43050057d2 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.553908:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050057c4 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d18 expref: 114 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.553914:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050057c4 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d18 expref: 114 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.553921:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ad8c0, rc 0) 00010000:00000080:3.0:1715205774.553924:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880099e6b900 x1798520455704896/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 584/640 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.553960:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e6b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+113:11754:x1798520455704896:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 308us (385us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205774.553965:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1485 00000100:00100000:3.0:1715205774.555288:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455705024 00000100:00100000:3.0:1715205774.555308:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1486 00000100:00100000:3.0:1715205774.555312:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+113:11754:x1798520455705024:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.555320:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.555321:0:14185:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1715205774.555332:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21d40/0xb608af4305005793 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d03 expref: 113 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.555343:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:3.0:1715205774.555345:0:14185:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205774.555350:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050057d9 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22d1f expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.555411:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050057e0 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.555420:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050057e0 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.555426:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050057e0 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.555434:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050057e7 lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0x68e4194e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.555439:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050057e7 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.555444:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050057e7 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715205774.555739:0:14185:0:(osp_object.c:1645:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x100000000:0x17b2:0x0], index 0: 0 00010000:00010000:3.0:1715205774.555868:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af43050057ee lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.555875:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af43050057ee lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.555881:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af43050057ee lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.555904:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050057e0 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.555909:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050057e0 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.555914:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050057e0 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.555919:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ae400 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.555921:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050057e0 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.555927:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050057e0 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.555932:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:3.0:1715205774.555934:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.555936:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050057e0 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.555940:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050057e0 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715205774.555948:0:14185:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff8800a61b2140 reply state ffff8800b1f96000 transno 330712482413 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050057e7 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.555964:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050057d9 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d1f expref: 115 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.555972:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af43050057ee lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d1f expref: 114 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.555976:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1003:0x0].0x0 (ffff88008f030c00) 00010000:00010000:3.0:1715205774.555978:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1715205774.555979:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73adf80, rc 0) 00010000:00000080:3.0:1715205774.555982:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b2140 x1798520455705024/t330712482413(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 656/656 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.556011:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+115:11754:x1798520455705024:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 699us (742us total) trans 330712482413 rc 0/0 00000100:00100000:3.0:1715205774.556017:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1486 00000100:00100000:3.0:1715205774.557265:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455705088 00000100:00100000:3.0:1715205774.557293:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1487 00000100:00100000:3.0:1715205774.557298:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb50c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+114:11754:x1798520455705088:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.557308:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.557315:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050057fc lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22d26 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.557339:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305005803 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.557346:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305005803 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.557352:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305005803 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205774.557366:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205774.557373:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305005803 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.557380:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305005803 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.557391:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050057fc lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d26 expref: 116 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.557404:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305005803 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d26 expref: 115 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.557413:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1003:0x0].0x0 (ffff88008f030c00) 00010000:00010000:3.0:1715205774.557415:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205774.557416:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73add40, rc 0) 00010000:00000080:3.0:1715205774.557419:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb50c0 x1798520455705088/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 576/696 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.557459:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb50c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+115:11754:x1798520455705088:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 160us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.557464:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1487 00000100:00100000:3.0:1715205774.559636:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455705216 00000100:00100000:3.0:1715205774.559672:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1488 00000100:00100000:3.0:1715205774.559675:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+115:11754:x1798520455705216:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.559683:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.559691:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305005811 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22d34 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.559719:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005818 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.559727:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005818 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.559734:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005818 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.559745:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af430500581f lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.559753:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af430500581f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.559758:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af430500581f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.559814:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005818 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.559819:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005818 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.559824:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005818 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.559828:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ae1c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.559831:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005818 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.559836:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005818 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.559843:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:3.0:1715205774.559845:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.559846:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005818 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.559851:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005818 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.559862:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af430500581f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.559867:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af430500581f lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.559881:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af430500581f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.559885:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ac900 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.559887:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af430500581f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.559891:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af430500581f lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.559896:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x7fa9a95 (ffff88008f030a00) 00010000:00010000:3.0:1715205774.559897:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.559899:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af430500581f lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.559902:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af430500581f lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.559931:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305005811 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d34 expref: 116 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.559936:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305005811 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d34 expref: 116 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.559946:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ac240, rc 0) 00010000:00000080:3.0:1715205774.559949:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb2600 x1798520455705216/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 584/640 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.559987:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+115:11754:x1798520455705216:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 310us (430us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205774.559992:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1488 00000100:00100000:3.0:1715205774.561543:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455705280 00000100:00100000:3.0:1715205774.561584:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1489 00000100:00100000:3.0:1715205774.561588:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+115:11754:x1798520455705280:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.561597:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.561607:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305005826 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22d3b expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.561644:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305005826 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d3b expref: 116 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.561652:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305005826 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d3b expref: 116 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.561657:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:3.0:1715205774.561658:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.561660:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ac480, rc 0) 00010000:00000080:3.0:1715205774.561662:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb1300 x1798520455705280/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 328/344 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.561696:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+116:11754:x1798520455705280:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 108us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.561702:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1489 00000100:00100000:3.0:1715205774.563171:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455705344 00000100:00100000:3.0:1715205774.563208:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 388 00000100:00100000:3.0:1715205774.563212:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1773440 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+116:11754:x1798520455705344:12345-192.168.204.8@tcp:37:dbench.0 00010000:00000080:3.0:1715205774.565370:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1773440 x1798520455705344/t0(0) o37->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 448/440 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.565409:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1773440 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+116:11754:x1798520455705344:12345-192.168.204.8@tcp:37:dbench.0 Request processed in 2196us (2285us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.565417:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 388 00000100:00100000:3.0:1715205774.570559:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455705600 00000100:00100000:3.0:1715205774.570587:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 389 00000100:00100000:3.0:1715205774.570592:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1772f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+116:11754:x1798520455705600:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:3.0:1715205774.570831:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1772f80 x1798520455705600/t330712482414(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 392/456 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.570872:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1772f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+117:11754:x1798520455705600:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 280us (346us total) trans 330712482414 rc 0/0 00000100:00100000:3.0:1715205774.570879:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 389 00000100:00100000:3.0:1715205774.572568:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455705728 00000100:00100000:3.0:1715205774.572589:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1490 00000100:00100000:3.0:1715205774.572593:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1772ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+117:11754:x1798520455705728:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.572607:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.572643:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af4305005834 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22d49 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.572698:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af430500583b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.572709:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305005803 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d26 expref: 118 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.572715:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af430500583b lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.572738:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305005803 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d26 expref: 118 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.572747:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305005803 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d26 expref: 118 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.572757:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099e6da40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456019456:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205774.572804:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f20c0 going to sleep for 6 seconds 00000100:00100000:3.0:1715205774.573597:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099e6da40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456019456:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205774.573610:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af430500583b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.574117:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af430500583b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.574124:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af430500583b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205774.574140:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1003:0x0]: returning size 15360 00010000:00010000:3.0:1715205774.574228:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af4305005834 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d49 expref: 119 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.574240:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af430500583b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d49 expref: 118 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.574245:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1003:0x0].0x0 (ffff88008f030c00) 00010000:00010000:3.0:1715205774.574247:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1715205774.574248:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ae880, rc 0) 00010000:00000080:3.0:1715205774.574251:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1772ac0 x1798520455705728/t330712482415(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 648/656 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.574285:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1772ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+118:11754:x1798520455705728:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1691us (1798us total) trans 330712482415 rc 0/0 00000100:00100000:3.0:1715205774.574291:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1490 00000100:00100000:3.0:1715205774.575176:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455705856 00000100:00100000:3.0:1715205774.575205:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1491 00000100:00100000:3.0:1715205774.575208:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1774740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+118:11754:x1798520455705856:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.575218:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.575226:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305005849 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22d50 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.575255:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305005850 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.575262:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af430500583b lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d49 expref: 119 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.575267:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305005850 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.575282:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af430500583b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d49 expref: 119 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.575290:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af430500583b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d49 expref: 119 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.575298:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880099e6da40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456019520:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205774.575335:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f20c0 going to sleep for 6 seconds 00000100:00100000:3.0:1715205774.576009:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880099e6da40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456019520:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205774.576020:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305005850 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.576190:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305005850 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.576197:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305005850 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205774.576216:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1003:0x0]: returning size 15360 00000004:00200000:3.0:1715205774.576219:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205774.576230:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305005850 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.576236:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305005850 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.576250:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305005849 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d50 expref: 119 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.576264:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305005850 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d50 expref: 118 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.576269:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1003:0x0].0x0 (ffff88008f030c00) 00010000:00010000:3.0:1715205774.576270:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205774.576272:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ac900, rc 0) 00010000:00000080:3.0:1715205774.576276:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1774740 x1798520455705856/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 576/696 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.576303:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1774740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+118:11754:x1798520455705856:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1089us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.576309:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1491 00000100:00100000:3.0:1715205774.577511:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455706048 00000100:00100000:3.0:1715205774.577531:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1492 00000100:00100000:3.0:1715205774.577533:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+118:11754:x1798520455706048:12345-192.168.204.8@tcp:36:dbench.0 00010000:00010000:3.0:1715205774.577552:0:14185:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205774.577559:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305005850 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d50 expref: 118 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.577567:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1003:0x0].0x0 (ffff88008f030c00) 00010000:00010000:3.0:1715205774.577569:0:14185:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205774.577582:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005857 lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.577590:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005857 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.577593:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005857 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715205774.577689:0:14185:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff880134ad17c0 reply state ffff8800916bb000 transno 330712482416 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005857 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00000080:3.0:1715205774.577703:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880134ad17c0 x1798520455706048/t330712482416(0) o36->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 488/456 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.577728:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+119:11754:x1798520455706048:12345-192.168.204.8@tcp:36:dbench.0 Request processed in 194us (282us total) trans 330712482416 rc 0/0 00000100:00100000:3.0:1715205774.577732:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1492 00010000:00010000:3.0:1715205774.578493:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005857 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.578500:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005857 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.578505:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005857 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.578510:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ae1c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.578513:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005857 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.578518:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005857 lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.578525:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1003:0x0].0x0 (ffff88008f030c00) 00010000:00010000:3.0:1715205774.578526:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.578528:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005857 lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.578531:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005857 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205774.579940:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455706176 00000100:00100000:3.0:1715205774.580414:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1493 00000100:00100000:3.0:1715205774.580419:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b3dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+118:11754:x1798520455706176:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.580433:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.580443:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af430500585e lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22d57 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.580477:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305005865 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.580484:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305005865 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.580491:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305005865 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205774.580511:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1003:0x0]: returning size 15360 00000004:00200000:3.0:1715205774.580514:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205774.580524:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305005865 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.580534:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305005865 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.580549:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af430500585e lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d57 expref: 120 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.580565:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305005865 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d57 expref: 119 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.580570:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1003:0x0].0x0 (ffff88008f030c00) 00010000:00010000:3.0:1715205774.580572:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205774.580573:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73adb00, rc 0) 00010000:00000080:3.0:1715205774.580576:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b3dc0 x1798520455706176/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 576/696 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.580647:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b3dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+119:11754:x1798520455706176:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 228us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.580654:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1493 00000100:00100000:3.0:1715205774.581781:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1715205774.583111:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1440/0xb608af430500586c lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.583119:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1440/0xb608af430500586c lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.583124:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1440/0xb608af430500586c lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.583129:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c1440 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.583133:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1440/0xb608af430500586c lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.583139:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1440/0xb608af430500586c lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.583147:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1003:0x0].0x0 (ffff88008f030c00) 00010000:00010000:3.0:1715205774.583149:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.583151:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1440/0xb608af430500586c lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.583155:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1440/0xb608af430500586c lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205774.584986:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455706496 00000100:00100000:3.0:1715205774.585026:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 390 00000100:00100000:3.0:1715205774.585031:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a484c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+119:11754:x1798520455706496:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:3.0:1715205774.585191:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009a484c00 x1798520455706496/t330712482418(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 392/456 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.585228:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a484c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+120:11754:x1798520455706496:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 198us (310us total) trans 330712482418 rc 0/0 00000100:00100000:3.0:1715205774.585233:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 390 00000100:00100000:3.0:1715205774.586198:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.594785:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455707008 00000100:00100000:3.0:1715205774.594827:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 391 00000100:00100000:3.0:1715205774.594831:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134930050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+122:11754:x1798520455707008:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:3.0:1715205774.594958:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880134930050 x1798520455707008/t330712482420(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 392/456 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.595004:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134930050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+123:11754:x1798520455707008:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 171us (332us total) trans 330712482420 rc 0/0 00000100:00100000:3.0:1715205774.595010:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 391 00010000:00010000:3.0:1715205774.600269:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af43050058ea lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.600279:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af43050058ea lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.600284:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af43050058ea lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.600288:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c1680 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.600290:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af43050058ea lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.600295:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af43050058ea lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.600303:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x68e4194e (ffff880092bfc900) 00010000:00010000:3.0:1715205774.600305:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.600307:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af43050058ea lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.600311:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af43050058ea lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.600435:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af43050058e3 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.600441:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af43050058e3 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.600445:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af43050058e3 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.600449:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c06c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.600451:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af43050058e3 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.600455:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af43050058e3 lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.600461:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x7fa9a95 (ffff880092bfc700) 00010000:00010000:3.0:1715205774.600462:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.600464:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af43050058e3 lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.600468:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af43050058e3 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.600475:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1b00/0xb608af43050058f1 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.600479:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1b00/0xb608af43050058f1 lrc: 2/0,0 mode: EX/EX res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.600483:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1b00/0xb608af43050058f1 lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.600491:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c1b00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.600492:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1b00/0xb608af43050058f1 lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.600496:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1b00/0xb608af43050058f1 lrc: 4/0,0 mode: EX/EX res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.600500:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1003:0x0].0x0 (ffff880092bfcb00) 00010000:00010000:3.0:1715205774.600501:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1715205774.600502:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1b00/0xb608af43050058f1 lrc: 2/0,0 mode: --/EX res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.600506:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1b00/0xb608af43050058f1 lrc: 0/0,0 mode: --/EX res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205774.604530:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.606338:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1715205774.609087:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594fc0/0xb608af4305005930 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.609098:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594fc0/0xb608af4305005930 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205774.609128:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1003:0x0]: returning size 15360 00000004:00200000:3.0:1715205774.609132:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205774.609143:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594fc0/0xb608af4305005930 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.609150:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594fc0/0xb608af4305005930 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.609166:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595680/0xb608af4305005929 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d8f expref: 124 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.609189:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594fc0/0xb608af4305005930 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d8f expref: 123 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.609194:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1003:0x0].0x0 (ffff880092bfc600) 00010000:00010000:3.0:1715205774.609195:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205774.609197:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a7594fc0, rc 0) 00010000:00000080:3.0:1715205774.609201:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1772f80 x1798520455707584/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 576/696 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.609223:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1772f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+123:11754:x1798520455707584:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2736us (2887us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.609228:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1503 00000100:00100000:3.0:1715205774.612035:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455707776 00000100:00100000:3.0:1715205774.612063:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1504 00000100:00100000:3.0:1715205774.612071:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+123:11754:x1798520455707776:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.612084:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.612095:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305005937 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22d96 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.612155:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af430500593e lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.612166:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af430500593e lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.612177:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af430500593e lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205774.612185:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1001:0x0]: returning size 53 00010000:00010000:3.0:1715205774.612271:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305005937 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d96 expref: 126 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.612283:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af430500593e lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d96 expref: 125 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.612287:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1001:0x0].0x0 (ffff88012cbdc900) 00010000:00010000:3.0:1715205774.612288:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1715205774.612289:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ae400, rc 0) 00010000:00000080:3.0:1715205774.612292:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb5a40 x1798520455707776/t330712482423(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 648/656 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.612334:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+125:11754:x1798520455707776:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 266us (381us total) trans 330712482423 rc 0/0 00000100:00100000:3.0:1715205774.612340:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1504 00000100:00100000:3.0:1715205774.613551:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455707968 00000100:00100000:3.0:1715205774.613581:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 392 00000100:00100000:3.0:1715205774.613585:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a480e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+125:11754:x1798520455707968:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:3.0:1715205774.613682:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009a480e40 x1798520455707968/t330712482424(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 392/456 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.613703:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a480e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+125:11754:x1798520455707968:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 118us (196us total) trans 330712482424 rc 0/0 00000100:00100000:3.0:1715205774.613711:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 392 00000100:00100000:3.0:1715205774.615107:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455708096 00000100:00100000:3.0:1715205774.615134:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1505 00000100:00100000:3.0:1715205774.615138:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a483440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+125:11754:x1798520455708096:12345-192.168.204.8@tcp:36:dbench.0 00010000:00010000:3.0:1715205774.615162:0:14860:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1715205774.615178:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af43050056e4 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22cbd expref: 125 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.615194:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7597cc0/0xb608af43050056cf lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22cb6 expref: 124 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.615201:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1001:0x0].0x0 (ffff88012cbdc900) 00010000:00010000:3.0:1715205774.615207:0:14860:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205774.615222:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af430500594c lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.615231:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af430500594c lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.615237:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af430500594c lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.615247:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005953 lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0x7f675ee7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.615252:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005953 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.615261:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005953 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.615336:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af430500595a lrc: 3/0,1 mode: --/EX res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.615342:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af430500595a lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.615347:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af430500595a lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1715205774.615614:0:14860:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x134:0x0].66, 64 off12416 00010000:00010000:3.0:1715205774.615704:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305005961 lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.615710:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305005961 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.615716:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305005961 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.615722:0:14860:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305005961 lrc: 4/0,1 mode: PW/PW res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.615726:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305005961 lrc: 4/0,1 mode: PW/PW res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.615731:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305005961 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.615755:0:14860:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1715205774.615775:0:14860:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88009a483440 reply state ffff8800916be000 transno 330712482425 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af430500595a lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.615808:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af430500594c lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.615812:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af430500594c lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.615816:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af430500594c lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.615820:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ad8c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.615822:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af430500594c lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.615826:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af430500594c lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.615832:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:3.0:1715205774.615833:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.615835:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af430500594c lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.615838:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af430500594c lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715205774.615844:0:14860:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88009a483440 reply state ffff8800916be000 transno 330712482425 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005953 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00000080:3.0:1715205774.615855:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009a483440 x1798520455708096/t330712482425(0) o36->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 496/456 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.615894:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a483440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+125:11754:x1798520455708096:12345-192.168.204.8@tcp:36:dbench.0 Request processed in 755us (846us total) trans 330712482425 rc 0/0 00000100:00100000:3.0:1715205774.615899:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1505 00010000:00010000:3.0:1715205774.617064:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005953 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.617072:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005953 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.617077:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005953 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.617082:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73aeac0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.617084:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005953 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.617088:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005953 lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.617095:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x7f675ee7 (ffff88008f030200) 00010000:00010000:3.0:1715205774.617097:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.617099:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005953 lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.617103:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005953 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.617115:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af430500595a lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.617119:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af430500595a lrc: 2/0,0 mode: EX/EX res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.617123:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af430500595a lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.617127:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73aef40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.617128:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af430500595a lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.617132:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af430500595a lrc: 4/0,0 mode: EX/EX res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.617138:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1001:0x0].0x0 (ffff88008f030400) 00010000:00010000:3.0:1715205774.617139:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1715205774.617140:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af430500595a lrc: 2/0,0 mode: --/EX res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.617316:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af430500595a lrc: 0/0,0 mode: --/EX res: [0x20001b1b3:0x1001:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205774.617886:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455708160 00000100:00100000:3.0:1715205774.617942:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1506 00000100:00100000:3.0:1715205774.617946:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a484c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+124:11754:x1798520455708160:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.617959:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.617968:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af4305005968 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22d9d expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.618101:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500596f lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.618108:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500596f lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.618114:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500596f lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.618123:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305005976 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x4f4f46 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.618128:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305005976 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.618133:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305005976 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.618173:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500596f lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.618178:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500596f lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.618183:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500596f lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.618187:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73acd80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.618189:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500596f lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.618193:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500596f lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.618199:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:3.0:1715205774.618201:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.618202:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500596f lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.618206:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500596f lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.618218:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305005976 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.618222:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305005976 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.618226:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305005976 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.618230:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73af3c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.618231:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305005976 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.618235:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305005976 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.618241:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x4f4f46 (ffff88008f030500) 00010000:00010000:3.0:1715205774.618243:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.618244:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305005976 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.618248:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305005976 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.618275:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af4305005968 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d9d expref: 125 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.618281:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af4305005968 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d9d expref: 125 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.618287:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73af180, rc 0) 00010000:00000080:3.0:1715205774.618290:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009a484c00 x1798520455708160/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 576/640 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.618330:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a484c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+124:11754:x1798520455708160:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 382us (486us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205774.618335:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1506 00000100:00100000:3.0:1715205774.619560:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455708224 00000100:00100000:3.0:1715205774.619589:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1507 00000100:00100000:3.0:1715205774.619592:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a483900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+124:11754:x1798520455708224:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.619601:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.619608:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af430500597d lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22da4 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.619653:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af430500597d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22da4 expref: 125 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.619667:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af430500597d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22da4 expref: 125 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.619672:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:3.0:1715205774.619674:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.619675:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73af840, rc 0) 00010000:00000080:3.0:1715205774.619678:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009a483900 x1798520455708224/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 328/344 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.619712:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a483900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+125:11754:x1798520455708224:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 118us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.619717:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1507 00000100:00100000:3.0:1715205774.621244:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455708288 00000100:00100000:3.0:1715205774.621271:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 393 00000100:00100000:3.0:1715205774.621275:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a482f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+125:11754:x1798520455708288:12345-192.168.204.8@tcp:37:dbench.0 00010000:00000080:3.0:1715205774.623050:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009a482f80 x1798520455708288/t0(0) o37->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 448/440 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.623092:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a482f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+125:11754:x1798520455708288:12345-192.168.204.8@tcp:37:dbench.0 Request processed in 1815us (1920us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.623099:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 393 00000100:00100000:3.0:1715205774.624737:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455708352 00000100:00100000:3.0:1715205774.624816:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1508 00000100:00100000:3.0:1715205774.624821:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009274d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+125:11754:x1798520455708352:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.624833:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.624846:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af4305005984 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22dab expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.624886:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af430500598b lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.624896:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af430500598b lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.624905:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af430500598b lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.624916:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305005992 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x3d99db37 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.624921:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305005992 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.624925:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305005992 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.625095:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305005999 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xec0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.625102:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305005999 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xec0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.625107:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305005999 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xec0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205774.625124:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xec0:0x0]: returning size 260096 00000004:00200000:3.0:1715205774.625127:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205774.625145:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305005999 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xec0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.625152:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305005999 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xec0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.625157:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af430500598b lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.625162:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af430500598b lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.625167:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af430500598b lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.625171:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73afa80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.625174:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af430500598b lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.625179:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af430500598b lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.625186:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:3.0:1715205774.625188:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.625190:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af430500598b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.625193:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af430500598b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.625206:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305005992 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.625210:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305005992 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.625214:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305005992 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.625218:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73acb40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.625219:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305005992 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.625223:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305005992 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.625229:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x3d99db37 (ffff88008f030a00) 00010000:00010000:3.0:1715205774.625230:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.625231:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305005992 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.625235:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305005992 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.625259:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af4305005984 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22dab expref: 127 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.625268:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305005999 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xec0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22dab expref: 126 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.625273:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xec0:0x0].0x0 (ffff88008f030c00) 00010000:00010000:3.0:1715205774.625275:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205774.625276:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73af600, rc 0) 00010000:00000080:3.0:1715205774.625280:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009274d580 x1798520455708352/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 584/696 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.625315:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009274d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+126:11754:x1798520455708352:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 494us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.625321:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1508 00000100:00100000:3.0:1715205774.631752:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1812f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456019904:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205774.631780:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594240/0xb608af43050059bc lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xec0:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.632783:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594240/0xb608af43050059bc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xec0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.632790:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594240/0xb608af43050059bc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xec0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205774.632818:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xec0:0x0]: returning size 260096 00000004:00200000:3.0:1715205774.632821:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205774.632831:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594240/0xb608af43050059bc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xec0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.632838:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594240/0xb608af43050059bc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xec0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.632852:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595680/0xb608af43050059b5 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22db9 expref: 128 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.632863:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594240/0xb608af43050059bc lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xec0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22db9 expref: 127 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.632869:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xec0:0x0].0x0 (ffff88008f030c00) 00010000:00010000:3.0:1715205774.632871:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205774.632872:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a7594240, rc 0) 00010000:00000080:3.0:1715205774.632876:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009f6250c0 x1798520455708608/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 576/696 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.632906:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6250c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+127:11754:x1798520455708608:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2340us (2451us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.632911:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1510 00000100:00100000:3.0:1715205774.634448:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455708800 00000100:00100000:3.0:1715205774.634475:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 394 00000100:00100000:3.0:1715205774.634479:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f626880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+127:11754:x1798520455708800:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:3.0:1715205774.634654:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009f626880 x1798520455708800/t330712482427(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 392/456 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.634691:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f626880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:11754:x1798520455708800:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 212us (284us total) trans 330712482427 rc 0/0 00000100:00100000:3.0:1715205774.634697:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 394 00000100:00100000:3.0:1715205774.636552:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455708864 00000100:00100000:3.0:1715205774.636581:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1511 00000100:00100000:3.0:1715205774.636584:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:11754:x1798520455708864:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.636597:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.636608:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050059c3 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22dc0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.636662:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af43050059ca lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.636672:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af43050059ca lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.636680:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af43050059ca lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.636690:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050059d1 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x4f4f46 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.636705:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050059d1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.636710:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050059d1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.636757:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af43050059ca lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.636762:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af43050059ca lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.636778:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af43050059ca lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.636783:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ac000 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.636786:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af43050059ca lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.636791:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af43050059ca lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.636799:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:3.0:1715205774.636801:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.636804:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af43050059ca lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.636808:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af43050059ca lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.636821:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050059d1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.636825:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050059d1 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.636829:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050059d1 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.636832:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73adb00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.636834:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050059d1 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.636837:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050059d1 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.636843:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x4f4f46 (ffff88008f030a00) 00010000:00010000:3.0:1715205774.636844:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.636846:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050059d1 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.636853:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050059d1 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.636886:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050059c3 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22dc0 expref: 129 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.636891:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050059c3 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22dc0 expref: 129 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.636897:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ad8c0, rc 0) 00010000:00000080:3.0:1715205774.636900:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb3900 x1798520455708864/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 576/640 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.636939:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:11754:x1798520455708864:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 354us (454us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205774.636945:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1511 00000100:00100000:3.0:1715205774.638421:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455708928 00000100:00100000:3.0:1715205774.638452:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1512 00000100:00100000:3.0:1715205774.638456:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f622f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:11754:x1798520455708928:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.638465:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.638473:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af43050059d8 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22dc7 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.638499:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050059df lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.638507:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050059df lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.638514:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050059df lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.638523:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af43050059e6 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0xa12eb2e9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.638527:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af43050059e6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.638532:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af43050059e6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.638563:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050059df lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.638567:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050059df lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.638571:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050059df lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.638575:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73af600 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.638577:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050059df lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.638581:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050059df lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.638587:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:3.0:1715205774.638589:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.638590:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050059df lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.638594:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050059df lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.638602:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af43050059e6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.638606:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af43050059e6 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.638611:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af43050059e6 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.638614:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73afcc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.638616:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af43050059e6 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.638643:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af43050059e6 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.638649:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0xa12eb2e9 (ffff88008f030400) 00010000:00010000:3.0:1715205774.638650:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.638651:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af43050059e6 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.638656:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af43050059e6 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.638684:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af43050059d8 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22dc7 expref: 129 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.638690:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af43050059d8 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22dc7 expref: 129 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.638696:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ae640, rc 0) 00010000:00000080:3.0:1715205774.638699:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009f622f80 x1798520455708928/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 584/640 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.638742:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f622f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:11754:x1798520455708928:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 285us (375us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205774.638747:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1512 00000100:00100000:3.0:1715205774.640316:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455708992 00000100:00100000:3.0:1715205774.640368:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1513 00000100:00100000:3.0:1715205774.640374:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6263c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:11754:x1798520455708992:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.640389:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.640407:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af43050059ed lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22dce expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.640460:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af43050059f4 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.640473:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af43050059f4 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.640483:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af43050059f4 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.640495:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050059fb lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x83e4194e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.640500:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050059fb lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.640506:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050059fb lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.640561:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af43050059f4 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.640567:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af43050059f4 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.640573:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af43050059f4 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.640577:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73afa80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.640580:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af43050059f4 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.640586:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af43050059f4 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.640595:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:3.0:1715205774.640597:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.640600:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af43050059f4 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.640608:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af43050059f4 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.640641:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050059fb lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.640646:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050059fb lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.640651:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050059fb lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.640655:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73af180 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.640657:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050059fb lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.640661:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050059fb lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.640666:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x83e4194e (ffff88008f030d00) 00010000:00010000:3.0:1715205774.640668:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.640669:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050059fb lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.640673:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050059fb lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.640703:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af43050059ed lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22dce expref: 129 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.640713:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af43050059ed lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22dce expref: 129 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.640725:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73acb40, rc 0) 00010000:00000080:3.0:1715205774.640729:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009f6263c0 x1798520455708992/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 584/640 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.640793:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6263c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:11754:x1798520455708992:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 419us (557us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205774.640799:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1513 00000100:00100000:3.0:1715205774.641969:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1715205774.647390:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7596640/0xb608af4305005a25 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.647397:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7596640/0xb608af4305005a25 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.647402:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7596640/0xb608af4305005a25 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.647406:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a7596640 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.647408:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7596640/0xb608af4305005a25 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.647412:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7596640/0xb608af4305005a25 lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.647419:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x83e4194e (ffff8800a025eb00) 00010000:00010000:3.0:1715205774.647422:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.647423:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7596640/0xb608af4305005a25 lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.647427:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7596640/0xb608af4305005a25 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205774.650911:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.652048:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.653906:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1715205774.657968:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75958c0/0xb608af4305005a5d lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.657980:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75958c0/0xb608af4305005a5d lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205774.657993:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1004:0x0]: returning size 15360 00010000:00010000:3.0:1715205774.658099:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595440/0xb608af4305005a56 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22df8 expref: 134 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.658110:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75958c0/0xb608af4305005a5d lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22df8 expref: 133 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.658116:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1004:0x0].0x0 (ffff8800a025e700) 00010000:00010000:3.0:1715205774.658117:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1715205774.658119:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a75958c0, rc 0) 00010000:00000080:3.0:1715205774.658123:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb76c0 x1798520455709696/t330712482430(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 648/656 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.658222:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+132:11754:x1798520455709696:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2628us (2776us total) trans 330712482430 rc 0/0 00000100:00100000:3.0:1715205774.658228:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1517 00000100:00100000:3.0:1715205774.660221:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455709824 00000100:00100000:3.0:1715205774.660253:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1518 00000100:00100000:3.0:1715205774.660257:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a18176c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+132:11754:x1798520455709824:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.660272:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.660283:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305005a6b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22dff expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.660315:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305005a72 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.660326:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75958c0/0xb608af4305005a5d lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22df8 expref: 133 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.660331:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305005a72 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.660352:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75958c0/0xb608af4305005a5d lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22df8 expref: 133 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.660361:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75958c0/0xb608af4305005a5d lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22df8 expref: 133 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.660370:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f112f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456020160:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205774.660419:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f2b40 going to sleep for 6 seconds 00000100:00100000:3.0:1715205774.661826:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.661854:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455709888 00010000:00010000:3.0:1715205774.661869:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75958c0/0xb608af4305005a5d lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22df8 expref: 134 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.661895:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4560 00000100:00100000:3.0:1715205774.661898:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f115f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+134:1830:x1798520455709888:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205774.661906:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205774.661910:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75958c0/0xb608af4305005a5d lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22df8 expref: 134 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.661917:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75958c0/0xb608af4305005a5d lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22df8 expref: 134 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.661930:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75958c0/0xb608af4305005a5d lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22df8 expref: 134 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.661939:0:19709:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1004:0x0].0x0 (ffff8800a025e700) 00010000:00010000:3.0:1715205774.661942:0:19709:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305005a72 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.661949:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305005a72 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.661954:0:19709:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305005a72 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.661976:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205774.661996:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f115f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+133:1830:x1798520455709888:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 97us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.662002:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4560 00000100:00100000:3.0:1715205774.664504:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1715205774.665980:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595680/0xb608af4305005a79 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.665986:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595680/0xb608af4305005a79 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.665990:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595680/0xb608af4305005a79 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.665993:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a7595680 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.665994:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595680/0xb608af4305005a79 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.665998:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595680/0xb608af4305005a79 lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.666003:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1004:0x0].0x0 (ffff8800a025e700) 00010000:00010000:3.0:1715205774.666004:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.666005:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595680/0xb608af4305005a79 lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.666008:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595680/0xb608af4305005a79 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205774.666121:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.667550:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455710144 00000100:00100000:3.0:1715205774.667572:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1520 00000100:00100000:3.0:1715205774.667884:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364af200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+132:11754:x1798520455710144:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.667899:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.667912:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305005a80 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22e06 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.667947:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005a87 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.667956:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005a87 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.667963:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005a87 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205774.667985:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1004:0x0]: returning size 15360 00000004:00200000:3.0:1715205774.667987:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205774.667996:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005a87 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.668002:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005a87 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.668015:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305005a80 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22e06 expref: 134 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.668025:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005a87 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22e06 expref: 133 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.668031:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1004:0x0].0x0 (ffff8800a025e700) 00010000:00010000:3.0:1715205774.668032:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205774.668034:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73aeac0, rc 0) 00010000:00000080:3.0:1715205774.668037:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364af200 x1798520455710144/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 576/696 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.668073:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364af200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+133:11754:x1798520455710144:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 190us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.668078:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1520 00000100:00100000:3.0:1715205774.669703:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1715205774.671206:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594b40/0xb608af4305005a8e lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.671214:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594b40/0xb608af4305005a8e lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.671218:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594b40/0xb608af4305005a8e lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.671222:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a7594b40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.671225:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594b40/0xb608af4305005a8e lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.671230:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594b40/0xb608af4305005a8e lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.671238:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1004:0x0].0x0 (ffff8800a025e700) 00010000:00010000:3.0:1715205774.671240:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.671241:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594b40/0xb608af4305005a8e lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.671245:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594b40/0xb608af4305005a8e lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205774.671944:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.674012:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455710400 00000100:00100000:3.0:1715205774.674042:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1522 00000100:00100000:3.0:1715205774.674046:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1815a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+133:11754:x1798520455710400:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.674061:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.674074:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305005a95 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22e0d expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.674114:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305005a9c lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.674124:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305005a9c lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.674131:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305005a9c lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.674141:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305005aa3 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0xd4e4194e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.674146:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305005aa3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.674150:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305005aa3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.674199:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305005a9c lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.674205:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305005a9c lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.674214:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305005a9c lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.674218:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ae400 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.674220:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305005a9c lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.674225:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305005a9c lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.674233:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:3.0:1715205774.674235:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.674237:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305005a9c lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.674241:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305005a9c lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.674251:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305005aa3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.674255:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305005aa3 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.674259:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305005aa3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.674262:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ac480 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.674264:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305005aa3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.674268:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305005aa3 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.674272:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0xd4e4194e (ffff88008f030500) 00010000:00010000:3.0:1715205774.674273:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.674274:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305005aa3 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.674278:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305005aa3 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.674309:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305005a95 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22e0d expref: 134 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.674314:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305005a95 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22e0d expref: 134 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.674322:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ad200, rc 0) 00010000:00000080:3.0:1715205774.674325:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1815a40 x1798520455710400/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 584/640 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.674366:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1815a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+133:11754:x1798520455710400:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 319us (633us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205774.674375:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1522 00000100:00100000:3.0:1715205774.677992:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.684111:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.688078:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455710976 00010000:00010000:3.0:1715205774.688109:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594fc0/0xb608af4305005930 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d8f expref: 138 pid: 14860 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.688148:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4561 00000100:00100000:3.0:1715205774.688154:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1816d40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+138:1830:x1798520455710976:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1715205774.688166:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205774.688171:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594fc0/0xb608af4305005930 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d8f expref: 138 pid: 14860 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.688180:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594fc0/0xb608af4305005930 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d8f expref: 138 pid: 14860 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.688200:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594fc0/0xb608af4305005930 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d8f expref: 138 pid: 14860 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.688213:0:19709:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1003:0x0].0x0 (ffff880092bfc600) 00010000:00010000:3.0:1715205774.688216:0:19709:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305005ab8 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.688224:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305005ab8 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.688230:0:19709:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305005ab8 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.688255:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205774.688296:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1816d40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+137:1830:x1798520455710976:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 142us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.688303:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4561 00010000:00010000:3.0:1715205774.700356:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22880/0xb608af4305005b05 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.700368:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22880/0xb608af4305005b05 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.700374:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22880/0xb608af4305005b05 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.700379:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099d22880 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.700381:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22880/0xb608af4305005b05 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.700387:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22880/0xb608af4305005b05 lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.700395:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x7fa9a95 (ffff880135bf2600) 00010000:00010000:3.0:1715205774.700397:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.700398:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22880/0xb608af4305005b05 lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.700403:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22880/0xb608af4305005b05 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.700416:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d221c0/0xb608af4305005b0c lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.700421:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d221c0/0xb608af4305005b0c lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.700426:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d221c0/0xb608af4305005b0c lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.700434:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099d221c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.700436:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d221c0/0xb608af4305005b0c lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.700440:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d221c0/0xb608af4305005b0c lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.700445:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0xd4e4194e (ffff880135bf2500) 00010000:00010000:3.0:1715205774.700447:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.700448:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d221c0/0xb608af4305005b0c lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.700452:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d221c0/0xb608af4305005b0c lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.700461:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22400/0xb608af4305005b13 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.700466:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22400/0xb608af4305005b13 lrc: 2/0,0 mode: EX/EX res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.700470:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22400/0xb608af4305005b13 lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.700473:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099d22400 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.700475:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22400/0xb608af4305005b13 lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.700479:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22400/0xb608af4305005b13 lrc: 4/0,0 mode: EX/EX res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.700486:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1003:0x0].0x0 (ffff880135bf2c00) 00010000:00010000:3.0:1715205774.700487:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1715205774.700489:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22400/0xb608af4305005b13 lrc: 2/0,0 mode: --/EX res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.700492:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22400/0xb608af4305005b13 lrc: 0/0,0 mode: --/EX res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.710310:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21680/0xb608af4305005b59 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.710316:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21680/0xb608af4305005b59 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.710320:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21680/0xb608af4305005b59 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.710323:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099d21680 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.710325:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21680/0xb608af4305005b59 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.710330:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21680/0xb608af4305005b59 lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.710337:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1003:0x0].0x0 (ffff880135bf2200) 00010000:00010000:3.0:1715205774.710338:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.710340:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21680/0xb608af4305005b59 lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.710349:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21680/0xb608af4305005b59 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.745250:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22d00/0xb608af4305005c32 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.745259:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22d00/0xb608af4305005c32 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.745265:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22d00/0xb608af4305005c32 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.745270:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099d22d00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.745273:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22d00/0xb608af4305005c32 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.745278:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22d00/0xb608af4305005c32 lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.745285:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1004:0x0].0x0 (ffff880135bf2400) 00010000:00010000:3.0:1715205774.745287:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.745289:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22d00/0xb608af4305005c32 lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.745293:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22d00/0xb608af4305005c32 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205774.762186:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.771415:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.773150:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.776534:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455715136 00000100:00100000:3.0:1715205774.776566:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1556 00000100:00100000:3.0:1715205774.776571:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c220e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+154:11754:x1798520455715136:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.776586:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.776600:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005d0b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22ee6 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.776662:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305005d12 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.776676:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305005d12 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.776685:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305005d12 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.776695:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305005d19 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x53504954 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.776701:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305005d19 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.776705:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305005d19 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.776760:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305005d12 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.776781:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305005d12 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.776787:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305005d12 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.776792:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73acd80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.776795:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305005d12 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.776801:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305005d12 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.776811:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:3.0:1715205774.776813:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.776816:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305005d12 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.776820:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305005d12 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.776832:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305005d19 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.776836:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305005d19 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.776840:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305005d19 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.776843:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73af3c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.776844:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305005d19 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.776849:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305005d19 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.776854:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x53504954 (ffff88012cbdcc00) 00010000:00010000:3.0:1715205774.776855:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.776856:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305005d19 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.776859:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305005d19 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.776888:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005d0b lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22ee6 expref: 155 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.776893:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305005d0b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22ee6 expref: 155 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.776899:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73aeac0, rc 0) 00010000:00000080:3.0:1715205774.776902:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c220e40 x1798520455715136/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 576/640 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.776942:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c220e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+154:11754:x1798520455715136:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 370us (437us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205774.776947:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1556 00000100:00100000:3.0:1715205774.777955:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.778210:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455715200 00000100:00100000:3.0:1715205774.778230:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1557 00000100:00100000:3.0:1715205774.778233:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1150c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+154:11754:x1798520455715200:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.778242:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.778249:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af4305005d20 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22eed expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.778264:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af4305005d20 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22eed expref: 155 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.778273:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af4305005d20 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22eed expref: 155 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.778278:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:3.0:1715205774.778279:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.778281:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73adf80, rc 0) 00010000:00000080:3.0:1715205774.778283:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f1150c0 x1798520455715200/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 328/344 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.778307:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1150c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+155:11754:x1798520455715200:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 73us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.778311:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1557 00010000:00000080:3.0:1715205774.781807:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364a8000 x1798520455715264/t0(0) o37->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 448/440 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.781874:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+155:11754:x1798520455715264:12345-192.168.204.8@tcp:37:dbench.0 Request processed in 2060us (2142us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.781881:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 405 00000100:00100000:3.0:1715205774.783472:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.785487:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.788347:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.789616:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.790579:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.790598:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455715712 00000100:00100000:3.0:1715205774.790615:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 406 00000100:00100000:3.0:1715205774.790633:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f111300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+98:11754:x1798520455715712:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:3.0:1715205774.791017:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f111300 x1798520455715712/t330712482451(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 392/456 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.791040:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f111300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+99:11754:x1798520455715712:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 407us (462us total) trans 330712482451 rc 0/0 00000100:00100000:3.0:1715205774.791046:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 406 00000100:00100000:3.0:1715205774.792657:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.796567:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455716032 00000100:00100000:3.0:1715205774.796587:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 407 00000100:00100000:3.0:1715205774.796590:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091811850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+98:11754:x1798520455716032:12345-192.168.204.8@tcp:37:dbench.0 00000100:00100000:3.0:1715205774.802932:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.807557:0:19955:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455716480 00000100:00100000:3.0:1715205774.807579:0:19955:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14644 00000100:00100000:3.0:1715205774.807583:0:19955:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364aaac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+45:1830:x1798520455716480:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.807592:0:19955:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.807611:0:19955:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a73aeac0/0xb608af4305005e1c lrc: 2/0,0 mode: --/PR res: [0x17b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22f41 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1715205774.807647:0:19955:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x17b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1715205774.807657:0:19955:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205774.807659:0:19955:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205774.807664:0:19955:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a73aeac0/0xb608af4305005e1c lrc: 3/0,0 mode: PR/PR res: [0x17b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f41 expref: 46 pid: 19955 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715205774.807678:0:19955:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a73aeac0/0xb608af4305005e1c lrc: 3/0,0 mode: PR/PR res: [0x17b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f41 expref: 46 pid: 19955 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715205774.807685:0:19955:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73aeac0, rc 0) 00000100:00100000:3.0:1715205774.807705:0:19955:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364aaac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+46:1830:x1798520455716480:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 121us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.807710:0:19955:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14644 00000100:00100000:3.0:1715205774.812336:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455716672 00000100:00100000:3.0:1715205774.812361:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 408 00000100:00100000:3.0:1715205774.812364:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c224280 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+98:11754:x1798520455716672:12345-192.168.204.8@tcp:37:dbench.0 00010000:00000080:3.0:1715205774.814126:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c224280 x1798520455716672/t0(0) o37->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 448/440 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.814162:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c224280 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+98:11754:x1798520455716672:12345-192.168.204.8@tcp:37:dbench.0 Request processed in 1797us (1880us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.814169:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 408 00000100:00100000:3.0:1715205774.817889:0:19955:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455716736 00000100:00100000:3.0:1715205774.817932:0:19955:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14645 00000100:00100000:3.0:1715205774.817937:0:19955:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+46:11754:x1798520455716736:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.817950:0:19955:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.817965:0:19955:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a73af3c0/0xb608af4305005e3f lrc: 2/0,0 mode: --/PW res: [0x17b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22f56 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.817987:0:19955:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a73aeac0/0xb608af4305005e1c lrc: 2/0,0 mode: PR/PR res: [0x17b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f41 expref: 47 pid: 19955 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715205774.817997:0:19955:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205774.817998:0:19955:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205774.818001:0:19955:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a73af3c0/0xb608af4305005e3f lrc: 4/0,0 mode: --/PW res: [0x17b4:0x0:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f56 expref: 47 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.818027:0:19955:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a73aeac0/0xb608af4305005e1c lrc: 3/0,0 mode: PR/PR res: [0x17b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f41 expref: 47 pid: 19955 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715205774.818036:0:19955:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a73aeac0/0xb608af4305005e1c lrc: 4/0,0 mode: PR/PR res: [0x17b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f41 expref: 47 pid: 19955 timeout: 3134 lvb_type: 1 00000100:00100000:3.0:1715205774.818045:0:19955:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f111300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19955:1798520456020992:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205774.818092:0:19955:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f29c0 going to sleep for 6 seconds 00000100:00100000:3.0:1715205774.819020:0:19955:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f111300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19955:1798520456020992:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205774.819046:0:19955:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a73af3c0/0xb608af4305005e3f lrc: 3/0,0 mode: --/PW res: [0x17b4:0x0:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f56 expref: 47 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.819063:0:19955:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73af3c0, rc 0) 00000100:00100000:3.0:1715205774.819111:0:19955:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099276850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+47:11754:x1798520455716736:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1172us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.819119:0:19955:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14645 00000100:00100000:3.0:1715205774.821179:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455716928 00000100:00100000:3.0:1715205774.821196:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 409 00000100:00100000:3.0:1715205774.821199:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c225a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+98:11754:x1798520455716928:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:3.0:1715205774.821394:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c225a40 x1798520455716928/t330712482454(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 392/456 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.821427:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c225a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+99:11754:x1798520455716928:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 227us (291us total) trans 330712482454 rc 0/0 00000100:00100000:3.0:1715205774.821431:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 409 00010000:00010000:3.0:1715205774.831234:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594d80/0xb608af4305005e69 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.831241:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594d80/0xb608af4305005e69 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.831246:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594d80/0xb608af4305005e69 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.831251:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a7594d80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.831253:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594d80/0xb608af4305005e69 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.831257:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594d80/0xb608af4305005e69 lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.831264:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1007:0x0].0x0 (ffff88012bf50400) 00010000:00010000:3.0:1715205774.831265:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.831267:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594d80/0xb608af4305005e69 lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.831270:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594d80/0xb608af4305005e69 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205774.831684:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.831702:0:19955:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455717440 00000100:00100000:3.0:1715205774.831722:0:19955:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14646 00000100:00100000:3.0:1715205774.831726:0:19955:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f111c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+46:1830:x1798520455717440:12345-192.168.204.8@tcp:2:dbench.0 00002000:00010000:3.0:1715205774.831897:0:19955:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x17b4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1715205774.831899:0:19955:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x17b4:0x0] updating lvb mtime from disk: 0 -> 1715205763 00002000:00010000:3.0:1715205774.831901:0:19955:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x17b4:0x0] updating lvb atime from disk: 0 -> 1715205765 00002000:00010000:3.0:1715205774.831903:0:19955:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x17b4:0x0] updating lvb ctime from disk: 0 -> 1715205775 00002000:00010000:3.0:1715205774.831904:0:19955:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x17b4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1715205774.831926:0:19955:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f111c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+47:1830:x1798520455717440:12345-192.168.204.8@tcp:2:dbench.0 Request processed in 200us (244us total) trans 30064771468 rc 0/0 00000100:00100000:3.0:1715205774.831932:0:19955:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14646 00000100:00100000:3.0:1715205774.838987:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455717824 00000100:00100000:3.0:1715205774.839009:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 410 00000100:00100000:3.0:1715205774.839013:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2263c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+101:11754:x1798520455717824:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:3.0:1715205774.839133:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c2263c0 x1798520455717824/t330712482458(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 392/456 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.839173:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2263c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+102:11754:x1798520455717824:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 159us (209us total) trans 330712482458 rc 0/0 00000100:00100000:3.0:1715205774.839179:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 410 00000100:00100000:3.0:1715205774.840565:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455717888 00000100:00100000:3.0:1715205774.840587:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1576 00000100:00100000:3.0:1715205774.840591:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c222f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+102:11754:x1798520455717888:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.840604:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.840632:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305005e85 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22f72 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840670:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305005e8c lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840681:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305005e8c lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840688:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305005e8c lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840699:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005e93 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0xa8353d69 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840704:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005e93 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840708:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005e93 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840799:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305005e9a lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840805:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305005e9a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840811:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305005e9a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205774.840833:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1007:0x0]: returning size 12006 00000004:00200000:3.0:1715205774.840836:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205774.840845:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305005e9a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840851:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305005e9a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840856:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305005e8c lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840861:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305005e8c lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840866:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305005e8c lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840870:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73acfc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.840873:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305005e8c lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840878:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305005e8c lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840886:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:3.0:1715205774.840888:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.840891:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305005e8c lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840895:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305005e8c lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840904:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005e93 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840908:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005e93 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840912:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005e93 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840916:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ae1c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.840917:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005e93 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840922:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005e93 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840927:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0xa8353d69 (ffff88008f030e00) 00010000:00010000:3.0:1715205774.840929:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.840930:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005e93 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840934:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005e93 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840952:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305005e85 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f72 expref: 104 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840962:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305005e9a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f72 expref: 103 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.840971:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1007:0x0].0x0 (ffff88012bf50400) 00010000:00010000:3.0:1715205774.840973:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205774.840974:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ae880, rc 0) 00010000:00000080:3.0:1715205774.840977:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c222f80 x1798520455717888/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 584/696 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.841004:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c222f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+103:11754:x1798520455717888:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 412us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.841009:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1576 00000100:00100000:3.0:1715205774.848542:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456021312:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205774.848559:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75946c0/0xb608af4305005ebd lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205774.848793:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455718208 00010000:00010000:3.0:1715205774.848804:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22880/0xb608af4305005ea8 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f79 expref: 106 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.848825:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4574 00000100:00100000:3.0:1715205774.848828:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c224740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+106:1831:x1798520455718208:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1715205774.848834:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205774.848837:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22880/0xb608af4305005ea8 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f79 expref: 106 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.848844:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22880/0xb608af4305005ea8 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f79 expref: 106 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.848858:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22880/0xb608af4305005ea8 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f79 expref: 106 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.848864:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1007:0x0].0x0 (ffff88012bf50400) 00010000:00010000:3.0:1715205774.848866:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75946c0/0xb608af4305005ebd lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.848870:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75946c0/0xb608af4305005ebd lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.848873:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75946c0/0xb608af4305005ebd lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.848888:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205774.848905:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c224740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+105:1831:x1798520455718208:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 77us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.848910:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4574 00000100:00100000:3.0:1715205774.850074:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455718336 00000100:00100000:3.0:1715205774.850091:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 411 00000100:00100000:3.0:1715205774.850094:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c225580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+104:11754:x1798520455718336:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:3.0:1715205774.850181:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c225580 x1798520455718336/t330712482460(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 392/456 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.850210:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c225580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+105:11754:x1798520455718336:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 115us (184us total) trans 330712482460 rc 0/0 00000100:00100000:3.0:1715205774.850214:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 411 00000100:00100000:3.0:1715205774.851298:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.852803:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455718464 00000100:00100000:3.0:1715205774.852825:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1580 00000100:00100000:3.0:1715205774.852828:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c223900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+105:11754:x1798520455718464:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.852834:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.852840:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305005ed9 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22f8e expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.852856:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305005ee0 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.852861:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305005ee0 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.852865:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305005ee0 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.852871:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305005ee7 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.852874:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305005ee7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.852877:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305005ee7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.852899:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305005ee0 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.852902:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305005ee0 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.852907:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305005ee0 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.852910:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ac900 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.852911:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305005ee0 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.852914:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305005ee0 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.852917:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:3.0:1715205774.852918:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.852919:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305005ee0 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.852921:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305005ee0 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.852931:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305005ee7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.852934:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305005ee7 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.852936:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305005ee7 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.852939:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ac240 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.852939:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305005ee7 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.852942:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305005ee7 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.852945:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x4b9bf994 (ffff880093bcaa00) 00010000:00010000:3.0:1715205774.852946:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.852946:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305005ee7 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.852949:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305005ee7 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.852963:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305005ed9 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f8e expref: 106 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.852966:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305005ed9 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f8e expref: 106 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.852972:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73add40, rc 0) 00010000:00000080:3.0:1715205774.852973:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c223900 x1798520455718464/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 584/640 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.852999:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c223900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+105:11754:x1798520455718464:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 171us (248us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205774.853003:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1580 00000100:00100000:3.0:1715205774.854112:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1715205774.855527:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7596400/0xb608af4305005efc lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.855538:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7596400/0xb608af4305005efc lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.855543:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7596400/0xb608af4305005efc lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.855547:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a7596400 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.855549:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7596400/0xb608af4305005efc lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.855553:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7596400/0xb608af4305005efc lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.855559:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0xa8353d69 (ffff88012d4a6000) 00010000:00010000:3.0:1715205774.855561:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.855563:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7596400/0xb608af4305005efc lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.855567:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7596400/0xb608af4305005efc lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.855577:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7596ac0/0xb608af4305005ef5 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.855580:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7596ac0/0xb608af4305005ef5 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.855584:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7596ac0/0xb608af4305005ef5 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.855592:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a7596ac0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.855593:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7596ac0/0xb608af4305005ef5 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.855597:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7596ac0/0xb608af4305005ef5 lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.855603:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x4b9bf994 (ffff88012d4a6d00) 00010000:00010000:3.0:1715205774.855605:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205774.855606:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7596ac0/0xb608af4305005ef5 lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.855610:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7596ac0/0xb608af4305005ef5 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.855644:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75973c0/0xb608af4305005f03 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.855649:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75973c0/0xb608af4305005f03 lrc: 2/0,0 mode: EX/EX res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.855653:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75973c0/0xb608af4305005f03 lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.855657:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a75973c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205774.855658:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75973c0/0xb608af4305005f03 lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.855662:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75973c0/0xb608af4305005f03 lrc: 4/0,0 mode: EX/EX res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.855668:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1007:0x0].0x0 (ffff88012d4a6600) 00010000:00010000:3.0:1715205774.855670:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1715205774.855671:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75973c0/0xb608af4305005f03 lrc: 2/0,0 mode: --/EX res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.855675:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a75973c0/0xb608af4305005f03 lrc: 0/0,0 mode: --/EX res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205774.855891:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.857653:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455718784 00000100:00100000:3.0:1715205774.857682:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1583 00000100:00100000:3.0:1715205774.857686:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c220980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+104:11754:x1798520455718784:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.857695:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.857704:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af4305005f26 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22f9c expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.857751:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305005f2d lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.857772:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7597cc0/0xb608af4305005f1f lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f95 expref: 105 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.857778:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305005f2d lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.857801:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7597cc0/0xb608af4305005f1f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f95 expref: 105 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.857814:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7597cc0/0xb608af4305005f1f lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f95 expref: 105 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.857823:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f111300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456021376:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205774.857868:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f23c0 going to sleep for 6 seconds 00000100:00100000:3.0:1715205774.859189:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455718848 00010000:00010000:3.0:1715205774.859217:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7597cc0/0xb608af4305005f1f lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f95 expref: 106 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.859241:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4575 00000100:00100000:3.0:1715205774.859246:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2204c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+106:1830:x1798520455718848:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1715205774.859256:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205774.859260:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7597cc0/0xb608af4305005f1f lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f95 expref: 106 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.859268:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7597cc0/0xb608af4305005f1f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f95 expref: 106 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.859289:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7597cc0/0xb608af4305005f1f lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f95 expref: 106 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.859302:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1007:0x0].0x0 (ffff88012d4a6400) 00010000:00010000:3.0:1715205774.859305:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305005f2d lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.859312:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305005f2d lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.859319:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305005f2d lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.859334:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205774.859365:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2204c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+105:1830:x1798520455718848:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 119us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.859371:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4575 00000100:00100000:3.0:1715205774.860663:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.860694:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455718912 00000100:00100000:3.0:1715205774.860719:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1584 00000100:00100000:3.0:1715205774.860722:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1117c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+105:11754:x1798520455718912:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.860737:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.860747:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305005f3b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22fa3 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.860797:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005f42 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.860807:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305005f2d lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f9c expref: 106 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.860813:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005f42 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.860835:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305005f2d lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f9c expref: 106 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.860844:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305005f2d lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f9c expref: 106 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.860855:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f111300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456021440:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205774.860893:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f2d80 going to sleep for 6 seconds 00000100:00100000:3.0:1715205774.861656:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f111300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456021440:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205774.861670:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005f42 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205774.861876:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1715205774.862105:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005f42 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.862112:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005f42 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205774.862139:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1007:0x0]: returning size 12006 00000004:00200000:3.0:1715205774.862143:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205774.862156:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005f42 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.862163:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005f42 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.862178:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305005f3b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22fa3 expref: 106 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.862189:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305005f42 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22fa3 expref: 105 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.862200:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1007:0x0].0x0 (ffff88012d4a6400) 00010000:00010000:3.0:1715205774.862202:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205774.862203:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ae1c0, rc 0) 00010000:00000080:3.0:1715205774.862207:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f1117c0 x1798520455718912/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 576/696 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.862232:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1117c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+105:11754:x1798520455718912:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1509us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.862237:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1584 00000100:00100000:3.0:1715205774.865647:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.867098:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c224c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456021504:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205774.867115:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594d80/0xb608af4305005f50 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1005:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205774.867387:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1715205774.868190:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594d80/0xb608af4305005f50 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1005:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.868196:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594d80/0xb608af4305005f50 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1005:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205774.868208:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1005:0x0]: returning size 53 00010000:00010000:3.0:1715205774.868307:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7596640/0xb608af4305005f49 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22faa expref: 108 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.868317:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594d80/0xb608af4305005f50 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1005:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22faa expref: 107 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.868327:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1005:0x0].0x0 (ffff880092bfcc00) 00010000:00010000:3.0:1715205774.868329:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1715205774.868330:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a7594d80, rc 0) 00010000:00000080:3.0:1715205774.868334:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f111300 x1798520455719104/t330712482463(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 648/656 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205774.868453:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f111300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+106:11754:x1798520455719104:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2691us (2808us total) trans 330712482463 rc 0/0 00000100:00100000:3.0:1715205774.868459:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1585 00000100:00100000:3.0:1715205774.869984:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455719232 00000100:00100000:3.0:1715205774.870016:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1586 00000100:00100000:3.0:1715205774.870021:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+106:11754:x1798520455719232:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205774.870033:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205774.870042:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305005f5e lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b22fb1 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.870076:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305005f65 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1005:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.870085:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594d80/0xb608af4305005f50 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1005:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22faa expref: 107 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.870090:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305005f65 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1005:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.870109:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594d80/0xb608af4305005f50 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1005:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22faa expref: 107 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.870122:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594d80/0xb608af4305005f50 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1005:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22faa expref: 107 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.870131:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009274a140 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456021568:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205774.870177:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f2d80 going to sleep for 6 seconds 00000100:00100000:3.0:1715205774.871544:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.871568:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455719296 00010000:00010000:3.0:1715205774.871582:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594d80/0xb608af4305005f50 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1005:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22faa expref: 108 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205774.871609:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4578 00000100:00100000:3.0:1715205774.871613:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009274ed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+108:1831:x1798520455719296:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1715205774.871638:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205774.871642:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594d80/0xb608af4305005f50 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1005:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22faa expref: 108 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.871650:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594d80/0xb608af4305005f50 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1005:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22faa expref: 108 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.871661:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594d80/0xb608af4305005f50 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1005:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22faa expref: 108 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:3.0:1715205774.871669:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1005:0x0].0x0 (ffff880092bfcc00) 00010000:00010000:3.0:1715205774.871671:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305005f65 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1005:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.871680:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305005f65 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1005:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.871685:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305005f65 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1005:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.871704:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205774.871726:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009274ed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+107:1831:x1798520455719296:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 111us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205774.871732:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4578 00000100:00100000:3.0:1715205774.873239:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.875819:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1715205774.876538:0:11161:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715205774.876542:0:11161:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595b00/0xb608af4305005f81 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x1005:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.876549:0:11161:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a7595b00 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:3.0:1715205774.876551:0:11161:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595b00/0xb608af4305005f81 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x1005:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.876557:0:11161:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595b00/0xb608af4305005f81 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1005:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.876565:0:11161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1005:0x0].0x0 (ffff88012d4a6700) 00010000:00010000:3.0:1715205774.876567:0:11161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715205774.876569:0:11161:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595b00/0xb608af4305005f81 lrc: 1/0,0 mode: --/PW res: [0x20001b1b3:0x1005:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.876578:0:11161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595b00/0xb608af4305005f81 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0x1005:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205774.876589:0:11161:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715205774.876590:0:11161:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715205774.876591:0:11161:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715205774.877968:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.880010:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.881502:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.885592:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.887321:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.889480:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.890666:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.891978:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.893751:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.897790:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.899413:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.900951:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.902450:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.904094:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.905727:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.907183:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00002000:00010000:1.0:1715205774.910381:0:19955:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x15d5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1715205774.910384:0:19955:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x15d5:0x0] updating lvb mtime from disk: 1715205764 -> 1715205752 00002000:00010000:1.0:1715205774.910386:0:19955:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x15d5:0x0] updating lvb atime from disk: 1715205766 -> 1715205756 00002000:00010000:1.0:1715205774.910387:0:19955:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x15d5:0x0] updating lvb ctime from disk: 1715205776 -> 1715205776 00002000:00010000:1.0:1715205774.910388:0:19955:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x15d5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1715205774.910429:0:19955:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2263c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+50:1830:x1798520455721088:12345-192.168.204.8@tcp:2:dbench.0 Request processed in 173us (277us total) trans 4294970689 rc 0/0 00000100:00100000:1.0:1715205774.910434:0:19955:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14651 00000100:00100000:3.0:1715205774.911358:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.913195:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.918914:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.922121:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.923570:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.926044:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.927149:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:1.0:1715205774.927292:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af430500606f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.927300:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af430500606f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205774.927325:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1007:0x0]: returning size 12006 00000004:00200000:1.0:1715205774.927329:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205774.927339:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af430500606f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.927346:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af430500606f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.927359:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170000/0xb608af4305006068 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23013 expref: 117 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.927372:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af430500606f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23013 expref: 116 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.927377:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1007:0x0].0x0 (ffff88012d4a6400) 00010000:00010000:1.0:1715205774.927379:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205774.927381:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099172400, rc 0) 00010000:00000080:1.0:1715205774.927384:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147e880 x1798520455721792/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 576/696 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205774.927405:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+116:11754:x1798520455721792:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1243us (1366us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205774.927410:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1601 00000100:00100000:3.0:1715205774.928560:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.930324:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205774.930369:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455722048 00000100:00100000:1.0:1715205774.930403:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1602 00000100:00100000:1.0:1715205774.930408:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+117:11754:x1798520455722048:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205774.930422:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205774.930435:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21680/0xb608af4305006076 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2301a expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.930473:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20900/0xb608af430500607d lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.930483:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20900/0xb608af430500607d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.930490:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20900/0xb608af430500607d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.930527:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d23840/0xb608af4305006084 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.930533:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d23840/0xb608af4305006084 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.930539:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d23840/0xb608af4305006084 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.930588:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20900/0xb608af430500607d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.930593:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20900/0xb608af430500607d lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.930598:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20900/0xb608af430500607d lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.930602:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099d20900 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205774.930605:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20900/0xb608af430500607d lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.930610:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20900/0xb608af430500607d lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.930638:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:1.0:1715205774.930639:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205774.930641:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20900/0xb608af430500607d lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.930644:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20900/0xb608af430500607d lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.930649:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d23840/0xb608af4305006084 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.930651:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d23840/0xb608af4305006084 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.930657:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d23840/0xb608af4305006084 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.930659:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099d23840 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205774.930660:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d23840/0xb608af4305006084 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.930662:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d23840/0xb608af4305006084 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.930665:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0xe7082257 (ffff880099676100) 00010000:00010000:1.0:1715205774.930666:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205774.930667:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d23840/0xb608af4305006084 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.930669:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d23840/0xb608af4305006084 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.930705:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21680/0xb608af4305006076 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2301a expref: 118 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.930709:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21680/0xb608af4305006076 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2301a expref: 118 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.930713:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099d21680, rc 0) 00010000:00000080:1.0:1715205774.930715:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880131478000 x1798520455722048/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 584/640 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205774.930755:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+117:11754:x1798520455722048:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 347us (434us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205774.930770:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1602 00000100:00100000:3.0:1715205774.932024:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205774.932190:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455722112 00000100:00100000:1.0:1715205774.932220:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1603 00000100:00100000:1.0:1715205774.932225:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801314784c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+117:11754:x1798520455722112:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205774.932233:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205774.932241:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d23600/0xb608af430500608b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23021 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.932266:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21b00/0xb608af4305006092 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.932290:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21b00/0xb608af4305006092 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.932298:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21b00/0xb608af4305006092 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.932307:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21200/0xb608af4305006099 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.932312:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21200/0xb608af4305006099 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.932316:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21200/0xb608af4305006099 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.932348:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21b00/0xb608af4305006092 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.932356:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21b00/0xb608af4305006092 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.932361:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21b00/0xb608af4305006092 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.932365:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099d21b00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205774.932367:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21b00/0xb608af4305006092 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.932372:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21b00/0xb608af4305006092 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.932378:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:1.0:1715205774.932380:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205774.932382:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21b00/0xb608af4305006092 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.932386:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21b00/0xb608af4305006092 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.932394:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21200/0xb608af4305006099 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.932398:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21200/0xb608af4305006099 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.932401:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21200/0xb608af4305006099 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.932408:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099d21200 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205774.932410:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21200/0xb608af4305006099 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.932414:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21200/0xb608af4305006099 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.932419:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0xe7082257 (ffff880099676a00) 00010000:00010000:1.0:1715205774.932421:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205774.932422:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21200/0xb608af4305006099 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.932426:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21200/0xb608af4305006099 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.932450:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d23600/0xb608af430500608b lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23021 expref: 118 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.932455:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d23600/0xb608af430500608b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23021 expref: 118 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.932460:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099d23600, rc 0) 00010000:00000080:1.0:1715205774.932464:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801314784c0 x1798520455722112/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 584/640 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205774.932508:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801314784c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+117:11754:x1798520455722112:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 282us (486us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205774.932513:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1603 00000100:00100000:3.0:1715205774.933451:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205774.933514:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455722240 00000100:00100000:1.0:1715205774.933530:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1604 00000100:00100000:1.0:1715205774.933534:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+117:11754:x1798520455722240:12345-192.168.204.8@tcp:36:dbench.0 00010000:00010000:1.0:1715205774.933556:0:14185:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1715205774.933572:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af430500606f lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23013 expref: 117 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.933583:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1007:0x0].0x0 (ffff88012d4a6400) 00010000:00010000:1.0:1715205774.933594:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af430500604c lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23005 expref: 116 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.933599:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:1.0:1715205774.933601:0:14185:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205774.933647:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22d00/0xb608af43050060a0 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.933654:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22d00/0xb608af43050060a0 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.933660:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22d00/0xb608af43050060a0 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.933669:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20d80/0xb608af43050060a7 lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.933674:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20d80/0xb608af43050060a7 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.933679:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20d80/0xb608af43050060a7 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.933693:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20b40/0xb608af43050060ae lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.933697:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20b40/0xb608af43050060ae lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.933702:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20b40/0xb608af43050060ae lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.933790:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d206c0/0xb608af43050060b5 lrc: 3/0,1 mode: --/EX res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.933797:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d206c0/0xb608af43050060b5 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.933802:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d206c0/0xb608af43050060b5 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715205774.934048:0:14185:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88013147d580 reply state ffff88012f39b000 transno 330712482475 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d206c0/0xb608af43050060b5 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715205774.934056:0:14185:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88013147d580 reply state ffff88012f39b000 transno 330712482475 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20b40/0xb608af43050060ae lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.934062:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22d00/0xb608af43050060a0 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.934065:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22d00/0xb608af43050060a0 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.934074:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22d00/0xb608af43050060a0 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.934078:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099d22d00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205774.934081:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22d00/0xb608af43050060a0 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.934086:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22d00/0xb608af43050060a0 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.934092:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:1.0:1715205774.934093:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205774.934095:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22d00/0xb608af43050060a0 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.934099:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22d00/0xb608af43050060a0 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715205774.934105:0:14185:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88013147d580 reply state ffff88012f39b000 transno 330712482475 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20d80/0xb608af43050060a7 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00000080:1.0:1715205774.934116:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147d580 x1798520455722240/t330712482475(0) o36->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 520/456 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205774.934163:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+117:11754:x1798520455722240:12345-192.168.204.8@tcp:36:dbench.0 Request processed in 628us (713us total) trans 330712482475 rc 0/0 00000100:00100000:1.0:1715205774.934169:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1604 00000100:00100000:3.0:1715205774.935109:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:1.0:1715205774.935137:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20d80/0xb608af43050060a7 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935145:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20d80/0xb608af43050060a7 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935151:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20d80/0xb608af43050060a7 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935155:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099d20d80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205774.935157:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20d80/0xb608af43050060a7 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935162:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20d80/0xb608af43050060a7 lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935169:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x4b9bf994 (ffff880099676e00) 00010000:00010000:1.0:1715205774.935171:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205774.935173:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20d80/0xb608af43050060a7 lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935177:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20d80/0xb608af43050060a7 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935188:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20b40/0xb608af43050060ae lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935192:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20b40/0xb608af43050060ae lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935196:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20b40/0xb608af43050060ae lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935205:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099d20b40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205774.935206:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20b40/0xb608af43050060ae lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935210:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20b40/0xb608af43050060ae lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935216:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0xe7082257 (ffff880099676b00) 00010000:00010000:1.0:1715205774.935217:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205774.935218:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20b40/0xb608af43050060ae lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935222:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20b40/0xb608af43050060ae lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935230:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d206c0/0xb608af43050060b5 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935234:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d206c0/0xb608af43050060b5 lrc: 2/0,0 mode: EX/EX res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935238:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d206c0/0xb608af43050060b5 lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935241:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099d206c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205774.935242:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d206c0/0xb608af43050060b5 lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935246:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d206c0/0xb608af43050060b5 lrc: 4/0,0 mode: EX/EX res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935251:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1007:0x0].0x0 (ffff880129f26a00) 00010000:00010000:1.0:1715205774.935253:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1715205774.935254:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d206c0/0xb608af43050060b5 lrc: 2/0,0 mode: --/EX res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935258:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d206c0/0xb608af43050060b5 lrc: 0/0,0 mode: --/EX res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205774.935278:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455722304 00000100:00100000:1.0:1715205774.935308:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1605 00000100:00100000:1.0:1715205774.935313:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+116:11754:x1798520455722304:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205774.935323:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205774.935328:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20480/0xb608af43050060bc lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23028 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935349:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22640/0xb608af43050060c3 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935355:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22640/0xb608af43050060c3 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935360:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22640/0xb608af43050060c3 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935367:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20fc0/0xb608af43050060ca lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935373:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20fc0/0xb608af43050060ca lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935378:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20fc0/0xb608af43050060ca lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935427:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22880/0xb608af43050060d1 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935433:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22880/0xb608af43050060d1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935438:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22880/0xb608af43050060d1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205774.935456:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1007:0x0]: returning size 12006 00000004:00200000:1.0:1715205774.935458:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205774.935466:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22880/0xb608af43050060d1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935473:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22880/0xb608af43050060d1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935477:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22640/0xb608af43050060c3 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935481:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22640/0xb608af43050060c3 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935485:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22640/0xb608af43050060c3 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935490:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099d22640 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205774.935492:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22640/0xb608af43050060c3 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935496:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22640/0xb608af43050060c3 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935502:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:1.0:1715205774.935504:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205774.935505:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22640/0xb608af43050060c3 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935509:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22640/0xb608af43050060c3 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935516:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20fc0/0xb608af43050060ca lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935520:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20fc0/0xb608af43050060ca lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935525:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20fc0/0xb608af43050060ca lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935529:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099d20fc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205774.935530:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20fc0/0xb608af43050060ca lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935534:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20fc0/0xb608af43050060ca lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935539:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0xe7082257 (ffff880129f26100) 00010000:00010000:1.0:1715205774.935540:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205774.935541:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20fc0/0xb608af43050060ca lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935545:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20fc0/0xb608af43050060ca lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935559:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d20480/0xb608af43050060bc lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23028 expref: 118 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935565:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22880/0xb608af43050060d1 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23028 expref: 117 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.935570:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1007:0x0].0x0 (ffff880129f26400) 00010000:00010000:1.0:1715205774.935571:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205774.935573:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099d22880, rc 0) 00010000:00000080:1.0:1715205774.935576:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147af80 x1798520455722304/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 584/696 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205774.935611:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+117:11754:x1798520455722304:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 298us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205774.935616:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1605 00000100:00100000:3.0:1715205774.937016:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205774.938635:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801364af6c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456022016:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205774.938653:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af43050060df lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205774.938679:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:1.0:1715205774.938904:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af43050060df lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.938911:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af43050060df lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205774.938923:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1007:0x0]: returning size 12006 00010000:00010000:1.0:1715205774.939006:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af43050060d8 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2302f expref: 119 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.939017:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af43050060df lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2302f expref: 118 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.939023:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1007:0x0].0x0 (ffff880129f26400) 00010000:00010000:1.0:1715205774.939025:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205774.939026:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099171680, rc 0) 00010000:00000080:1.0:1715205774.939029:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147d0c0 x1798520455722432/t330712482476(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 648/656 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205774.939052:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+118:11754:x1798520455722432:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1959us (2039us total) trans 330712482476 rc 0/0 00000100:00100000:1.0:1715205774.939058:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1606 00000100:00100000:1.0:1715205774.940319:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455722560 00000100:00100000:1.0:1715205774.940344:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1607 00000100:00100000:1.0:1715205774.940348:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2204c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+118:11754:x1798520455722560:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205774.940360:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205774.940368:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22400/0xb608af43050060ed lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23036 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.940399:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af43050060f4 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.940407:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af43050060df lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2302f expref: 119 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.940413:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af43050060f4 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.940430:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af43050060df lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2302f expref: 119 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.940438:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af43050060df lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2302f expref: 119 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:1.0:1715205774.940447:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009f620e40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456022080:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205774.940489:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b4600 going to sleep for 6 seconds 00000100:00100000:1.0:1715205774.941344:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009f620e40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456022080:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205774.941358:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af43050060f4 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.941604:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af43050060f4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.941612:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af43050060f4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205774.941655:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1007:0x0]: returning size 12006 00000004:00200000:1.0:1715205774.941658:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205774.941668:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af43050060f4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.941675:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af43050060f4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.941688:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d22400/0xb608af43050060ed lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23036 expref: 119 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.941698:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af43050060f4 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23036 expref: 118 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.941703:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1007:0x0].0x0 (ffff880129f26400) 00010000:00010000:1.0:1715205774.941705:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205774.941706:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59c000, rc 0) 00010000:00000080:1.0:1715205774.941710:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c2204c0 x1798520455722560/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 576/696 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205774.941741:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2204c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+118:11754:x1798520455722560:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1392us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205774.941746:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1607 00000100:00100000:1.0:1715205774.944374:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455722752 00000100:00100000:1.0:1715205774.944407:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1608 00000100:00100000:1.0:1715205774.944412:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009274d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+118:11754:x1798520455722752:12345-192.168.204.8@tcp:36:dbench.0 00010000:00010000:1.0:1715205774.944441:0:14185:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205774.944456:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af43050060f4 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23036 expref: 118 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.944466:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1007:0x0].0x0 (ffff880129f26400) 00010000:00010000:1.0:1715205774.944472:0:14185:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205774.944494:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af43050060fb lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.944506:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af43050060fb lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.944512:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af43050060fb lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715205774.944610:0:14185:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88009274d0c0 reply state ffff88012d190000 transno 330712482477 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af43050060fb lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00000080:1.0:1715205774.944653:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009274d0c0 x1798520455722752/t330712482477(0) o36->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 488/456 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205774.944718:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009274d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+119:11754:x1798520455722752:12345-192.168.204.8@tcp:36:dbench.0 Request processed in 305us (400us total) trans 330712482477 rc 0/0 00000100:00100000:1.0:1715205774.944724:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1608 00010000:00010000:1.0:1715205774.945359:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af43050060fb lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.945366:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af43050060fb lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.945371:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af43050060fb lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.945376:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59d200 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205774.945378:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af43050060fb lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.945383:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af43050060fb lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.945390:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1007:0x0].0x0 (ffff880129f26500) 00010000:00010000:1.0:1715205774.945392:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205774.945394:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af43050060fb lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.945398:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af43050060fb lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205774.945739:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455722816 00000100:00100000:1.0:1715205774.945772:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1609 00000100:00100000:1.0:1715205774.945775:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364ab440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+118:11754:x1798520455722816:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205774.945785:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205774.945792:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305006102 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2303d expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.945814:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305006102 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2303d expref: 119 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.945821:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305006102 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2303d expref: 119 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.945831:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1007:0x0].0x0 (ffff880129f26e00) 00010000:00010000:1.0:1715205774.945833:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1715205774.945834:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59eac0, rc 0) 00010000:00000080:1.0:1715205774.945836:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364ab440 x1798520455722816/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 376/400 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205774.945857:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364ab440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+119:11754:x1798520455722816:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 82us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205774.945862:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1609 00000100:00100000:1.0:1715205774.946995:0:19955:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455722880 00000100:00100000:1.0:1715205774.947023:0:19955:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14652 00000100:00100000:1.0:1715205774.947028:0:19955:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364a97c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+48:1831:x1798520455722880:12345-192.168.204.8@tcp:2:dbench.0 00002000:00010000:1.0:1715205774.947137:0:19955:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100000000:0x17b4:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1715205774.947139:0:19955:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100000000:0x17b4:0x0] updating lvb mtime from disk: 1715205751 -> 1715205763 00002000:00010000:1.0:1715205774.947141:0:19955:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100000000:0x17b4:0x0] updating lvb atime from disk: 1715205755 -> 1715205766 00002000:00010000:1.0:1715205774.947143:0:19955:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100000000:0x17b4:0x0] updating lvb ctime from disk: 1715205775 -> 1715205776 00002000:00010000:1.0:1715205774.947144:0:19955:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100000000:0x17b4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1715205774.947172:0:19955:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364a97c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+49:1831:x1798520455722880:12345-192.168.204.8@tcp:2:dbench.0 Request processed in 144us (330us total) trans 30064771470 rc 0/0 00000100:00100000:1.0:1715205774.947178:0:19955:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14652 00000100:00100000:1.0:1715205774.948429:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455723008 00000100:00100000:1.0:1715205774.948467:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 419 00000100:00100000:1.0:1715205774.948471:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091816850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+119:11754:x1798520455723008:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205774.948592:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880091816850 x1798520455723008/t330712482478(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 392/456 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205774.948651:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091816850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+120:11754:x1798520455723008:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 179us (288us total) trans 330712482478 rc 0/0 00000100:00100000:1.0:1715205774.948656:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 419 00000100:00100000:1.0:1715205774.949746:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455723072 00000100:00100000:1.0:1715205774.949810:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1610 00000100:00100000:1.0:1715205774.949815:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364a8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+120:11754:x1798520455723072:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205774.949834:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205774.949851:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af4305006109 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23044 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.949900:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305006110 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.949913:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305006110 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.949923:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305006110 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.949936:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305006117 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0xb9ed2257 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.949942:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305006117 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.949947:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305006117 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.950062:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500611e lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.950069:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500611e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.950076:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500611e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205774.950101:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1008:0x0]: returning size 11991 00000004:00200000:1.0:1715205774.950105:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205774.950116:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500611e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.950123:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500611e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.950129:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305006110 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.950134:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305006110 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.950138:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305006110 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.950142:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59e1c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205774.950145:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305006110 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.950150:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305006110 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.950159:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:1.0:1715205774.950161:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205774.950163:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305006110 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.950168:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305006110 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.950178:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305006117 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.950182:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305006117 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.950187:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305006117 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.950190:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59db00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205774.950191:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305006117 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.950195:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305006117 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.950199:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0xb9ed2257 (ffff880129f26b00) 00010000:00010000:1.0:1715205774.950200:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205774.950201:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305006117 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.950204:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305006117 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.950223:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af4305006109 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23044 expref: 122 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.950232:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500611e lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23044 expref: 121 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.950237:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1008:0x0].0x0 (ffff88012d4a6c00) 00010000:00010000:1.0:1715205774.950239:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205774.950241:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59c6c0, rc 0) 00010000:00000080:1.0:1715205774.950244:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364a8980 x1798520455723072/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 584/696 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205774.950289:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364a8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+121:11754:x1798520455723072:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 473us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205774.950294:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1610 00000100:00100000:1.0:1715205774.952232:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455723200 00000100:00100000:1.0:1715205774.952272:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1611 00000100:00100000:1.0:1715205774.952277:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+121:11754:x1798520455723200:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205774.952290:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205774.952303:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305006125 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2304b expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.952372:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af430500612c lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.952385:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500611e lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23044 expref: 122 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.952390:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af430500612c lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.952421:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500611e lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23044 expref: 122 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.952432:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500611e lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23044 expref: 122 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:1.0:1715205774.952449:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009f620e40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456022144:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205774.952508:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b4e40 going to sleep for 6 seconds 00000100:00100000:1.0:1715205774.953719:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205774.955256:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205774.956386:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:1.0:1715205774.956580:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006141 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.956588:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006141 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205774.956611:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1008:0x0]: returning size 11991 00000004:00200000:1.0:1715205774.956613:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205774.956644:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006141 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.956650:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006141 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.956665:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af430500613a lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23052 expref: 123 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.956673:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006141 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23052 expref: 122 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.956677:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1008:0x0].0x0 (ffff88012d4a6c00) 00010000:00010000:1.0:1715205774.956679:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205774.956680:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099170fc0, rc 0) 00010000:00000080:1.0:1715205774.956683:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009f6276c0 x1798520455723328/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 576/696 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205774.956702:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6276c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+122:11754:x1798520455723328:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1378us (1448us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205774.956706:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1612 00000100:00100000:1.0:1715205774.958586:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.959977:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205774.960088:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455723584 00000100:00100000:1.0:1715205774.960134:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1613 00000100:00100000:1.0:1715205774.960139:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+123:11754:x1798520455723584:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205774.960156:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205774.960171:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305006148 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23059 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.960210:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af430500614f lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.960220:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af430500614f lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.960228:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af430500614f lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.960239:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305006156 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.960244:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305006156 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.960252:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305006156 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.960303:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af430500614f lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.960309:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af430500614f lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.960313:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af430500614f lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.960318:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59f600 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205774.960321:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af430500614f lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.960326:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af430500614f lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.960334:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:1.0:1715205774.960337:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205774.960339:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af430500614f lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.960343:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af430500614f lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.960352:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305006156 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.960365:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305006156 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.960369:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305006156 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.960373:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59ed00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205774.960374:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305006156 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.960377:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305006156 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.960382:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x4b9bf994 (ffff880129f26300) 00010000:00010000:1.0:1715205774.960384:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205774.960385:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305006156 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.960388:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305006156 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.960417:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305006148 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23059 expref: 124 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.960422:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305006148 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23059 expref: 124 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.960429:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59dd40, rc 0) 00010000:00000080:1.0:1715205774.960433:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147c740 x1798520455723584/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:555/0 lens 584/640 e 0 to 0 dl 1715205780 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205774.960477:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+123:11754:x1798520455723584:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 338us (503us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205774.960482:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1613 00000100:00100000:1.0:1715205774.962889:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205774.966155:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205774.967895:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:1.0:1715205774.969344:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a400/0xb608af4305006187 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.969351:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a400/0xb608af4305006187 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.969355:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a400/0xb608af4305006187 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.969359:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012fb5a400 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205774.969360:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a400/0xb608af4305006187 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.969365:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a400/0xb608af4305006187 lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.969372:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0xb9ed2257 (ffff88012d4a6900) 00010000:00010000:1.0:1715205774.969374:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205774.969376:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a400/0xb608af4305006187 lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.969383:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a400/0xb608af4305006187 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.969393:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5b180/0xb608af4305006180 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.969398:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5b180/0xb608af4305006180 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.969402:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5b180/0xb608af4305006180 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.969406:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012fb5b180 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205774.969407:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5b180/0xb608af4305006180 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.969411:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5b180/0xb608af4305006180 lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.969416:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x4b9bf994 (ffff88012d4a6400) 00010000:00010000:1.0:1715205774.969418:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205774.969419:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5b180/0xb608af4305006180 lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.969423:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5b180/0xb608af4305006180 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.969431:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a640/0xb608af430500618e lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.969443:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a640/0xb608af430500618e lrc: 2/0,0 mode: EX/EX res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.969446:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a640/0xb608af430500618e lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.969450:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012fb5a640 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205774.969451:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a640/0xb608af430500618e lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.969455:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a640/0xb608af430500618e lrc: 4/0,0 mode: EX/EX res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.969460:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1008:0x0].0x0 (ffff88012d4a6800) 00010000:00010000:1.0:1715205774.969461:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1715205774.969462:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a640/0xb608af430500618e lrc: 2/0,0 mode: --/EX res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.969466:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a640/0xb608af430500618e lrc: 0/0,0 mode: --/EX res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205774.969604:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205774.975874:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205774.975899:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455724288 00010000:00010000:1.0:1715205774.975918:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af43050061b8 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23075 expref: 126 pid: 14860 timeout: 3134 lvb_type: 0 00000100:00100000:1.0:1715205774.975946:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4589 00000100:00100000:1.0:1715205774.975950:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f621c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+126:1830:x1798520455724288:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1715205774.975959:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205774.975962:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af43050061b8 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23075 expref: 126 pid: 14860 timeout: 3134 lvb_type: 0 00010000:00010000:1.0:1715205774.975969:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af43050061b8 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23075 expref: 126 pid: 14860 timeout: 3134 lvb_type: 0 00010000:00010000:1.0:1715205774.975981:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af43050061b8 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23075 expref: 126 pid: 14860 timeout: 3134 lvb_type: 0 00010000:00010000:1.0:1715205774.975990:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1008:0x0].0x0 (ffff88012d4a6d00) 00010000:00010000:1.0:1715205774.975993:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af43050061cd lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.975999:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af43050061cd lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.976005:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af43050061cd lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205774.976019:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205774.976052:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f621c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+125:1830:x1798520455724288:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 101us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205774.976132:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4589 00000100:00100000:1.0:1715205774.977670:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205774.979595:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.981014:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205774.984382:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.986275:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.988860:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205774.990036:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205774.991492:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.993091:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.995600:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205774.996770:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205774.997829:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205774.999127:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.000992:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.002279:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.004481:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.007178:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.009217:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.011064:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.013923:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455726144 00000100:00100000:3.0:1715205775.013950:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1634 00000100:00100000:3.0:1715205775.013955:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4404c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+131:11754:x1798520455726144:12345-192.168.204.8@tcp:36:dbench.0 00010000:00010000:3.0:1715205775.013984:0:14185:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.014001:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af430500629f lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230c2 expref: 131 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.014014:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1008:0x0].0x0 (ffff88012cbdc500) 00010000:00010000:3.0:1715205775.014016:0:14185:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205775.014041:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af43050062a6 lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.014049:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af43050062a6 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.014055:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af43050062a6 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715205775.014159:0:14185:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88012d4404c0 reply state ffff88008f9b2000 transno 330712482489 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af43050062a6 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00000080:3.0:1715205775.014228:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4404c0 x1798520455726144/t330712482489(0) o36->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 488/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.014278:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4404c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+132:11754:x1798520455726144:12345-192.168.204.8@tcp:36:dbench.0 Request processed in 323us (382us total) trans 330712482489 rc 0/0 00000100:00100000:3.0:1715205775.014284:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1634 00010000:00010000:3.0:1715205775.015327:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af43050062a6 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.015335:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af43050062a6 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.015340:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af43050062a6 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.015348:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ae1c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.015351:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af43050062a6 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.015361:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af43050062a6 lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.015368:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1008:0x0].0x0 (ffff88012cbdc500) 00010000:00010000:3.0:1715205775.015370:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.015371:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af43050062a6 lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.015375:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af43050062a6 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.027453:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801364ad0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456022400:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205775.027471:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af43050062d0 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.027709:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455726720 00010000:00010000:1.0:1715205775.027729:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5b600/0xb608af43050062c2 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230c9 expref: 136 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:1.0:1715205775.027747:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4590 00000100:00100000:1.0:1715205775.027751:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7054050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+136:1831:x1798520455726720:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1715205775.027769:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.027773:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5b600/0xb608af43050062c2 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230c9 expref: 136 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:1.0:1715205775.027781:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5b600/0xb608af43050062c2 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230c9 expref: 136 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:1.0:1715205775.027793:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5b600/0xb608af43050062c2 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230c9 expref: 136 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:1.0:1715205775.027802:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1003:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:1.0:1715205775.027805:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af43050062d0 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.027814:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af43050062d0 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.027817:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af43050062d0 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.027836:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205775.027853:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7054050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+135:1831:x1798520455726720:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 102us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.027856:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4590 00000100:00100000:3.0:1715205775.033888:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.035032:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.036296:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455727360 00000100:00100000:3.0:1715205775.036316:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1638 00000100:00100000:3.0:1715205775.036320:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d442140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+138:11754:x1798520455727360:12345-192.168.204.8@tcp:36:dbench.0 00010000:00010000:3.0:1715205775.036343:0:14185:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1715205775.036358:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2f40/0xb608af43050062e5 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230d7 expref: 138 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.036372:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d23a80/0xb608af4305005b60 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22e4c expref: 137 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.036378:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1003:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:3.0:1715205775.036385:0:14185:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205775.036402:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af43050062ec lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.036416:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af43050062ec lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.036423:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af43050062ec lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.036432:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af43050062f3 lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xebe:0x0].0xd4e4194e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.036437:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af43050062f3 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.036442:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af43050062f3 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.036518:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050062fa lrc: 3/0,1 mode: --/EX res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.036524:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050062fa lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.036529:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050062fa lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1715205775.036831:0:14185:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x134:0x0].69, 64 off12608 00010000:00010000:3.0:1715205775.036869:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305006301 lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.036875:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305006301 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.036882:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305006301 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.036887:0:14185:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305006301 lrc: 4/0,1 mode: PW/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.036891:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305006301 lrc: 4/0,1 mode: PW/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.036895:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305006301 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.036911:0:14185:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1715205775.036920:0:14185:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88012d442140 reply state ffff8800a1032000 transno 330712482496 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050062fa lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1003:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.036951:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af43050062ec lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.036956:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af43050062ec lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.036959:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af43050062ec lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.036962:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ae880 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.036963:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af43050062ec lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.036968:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af43050062ec lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.036972:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xebe:0x0].0x0 (ffff8800b410f700) 00010000:00010000:3.0:1715205775.036974:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.036975:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af43050062ec lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.036977:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af43050062ec lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715205775.036982:0:14185:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88012d442140 reply state ffff8800a1032000 transno 330712482496 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af43050062f3 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xebe:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00000080:3.0:1715205775.036990:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d442140 x1798520455727360/t330712482496(0) o36->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 496/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.037012:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d442140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+138:11754:x1798520455727360:12345-192.168.204.8@tcp:36:dbench.0 Request processed in 693us (733us total) trans 330712482496 rc 0/0 00000100:00100000:3.0:1715205775.037016:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1638 00000100:00100000:3.0:1715205775.038357:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.041121:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455727616 00010000:00010000:1.0:1715205775.041140:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ad00/0xb608af430500631d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230de expref: 140 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:1.0:1715205775.041154:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4592 00000100:00100000:1.0:1715205775.041157:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d441300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+140:1830:x1798520455727616:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1715205775.041162:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.041164:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ad00/0xb608af430500631d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230de expref: 140 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:1.0:1715205775.041169:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ad00/0xb608af430500631d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230de expref: 140 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:1.0:1715205775.041177:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ad00/0xb608af430500631d lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230de expref: 140 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:1.0:1715205775.041182:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1007:0x0].0x0 (ffff880129f26e00) 00010000:00010000:1.0:1715205775.041184:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59680/0xb608af430500632b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.041188:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59680/0xb608af430500632b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.041191:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59680/0xb608af430500632b lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.041199:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205775.041219:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d441300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+139:1830:x1798520455727616:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 62us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.041222:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4592 00000100:00100000:3.0:1715205775.042175:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455727680 00000100:00100000:3.0:1715205775.042201:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1641 00000100:00100000:3.0:1715205775.042205:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d445580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+139:11754:x1798520455727680:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.042215:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.042223:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af4305006339 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b230ec expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.042253:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006340 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.042260:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59680/0xb608af430500632b lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230e5 expref: 140 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.042264:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006340 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.042279:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59680/0xb608af430500632b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230e5 expref: 140 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.042285:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59680/0xb608af430500632b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230e5 expref: 140 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:3.0:1715205775.042293:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a66dcc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456022592:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205775.042325:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f2f00 going to sleep for 6 seconds 00000100:00100000:1.0:1715205775.043239:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455727744 00010000:00010000:1.0:1715205775.043261:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59680/0xb608af430500632b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230e5 expref: 141 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:1.0:1715205775.043283:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4593 00000100:00100000:1.0:1715205775.043287:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364ab900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+141:1830:x1798520455727744:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1715205775.043296:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.043305:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59680/0xb608af430500632b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230e5 expref: 141 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:1.0:1715205775.043313:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59680/0xb608af430500632b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230e5 expref: 141 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:1.0:1715205775.043327:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59680/0xb608af430500632b lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230e5 expref: 141 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:1.0:1715205775.043342:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1007:0x0].0x0 (ffff880129f26e00) 00010000:00010000:1.0:1715205775.043345:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006340 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.043352:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006340 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.043358:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006340 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1007:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.043374:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205775.043413:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364ab900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+140:1830:x1798520455727744:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 125us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.043420:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4593 00000100:00100000:3.0:1715205775.046131:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000400:00000080:3.0:1715205775.049866:0:17159:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1715205775.049868:0:17159:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:1.0:1715205775.050778:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455728192 00010000:00010000:1.0:1715205775.050802:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594480/0xb608af43050055cc lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c5b expref: 141 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:1.0:1715205775.050835:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4594 00000100:00100000:1.0:1715205775.050849:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364a8e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+141:1830:x1798520455728192:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1715205775.050860:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.050864:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594480/0xb608af43050055cc lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c5b expref: 141 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:1.0:1715205775.050872:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594480/0xb608af43050055cc lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c5b expref: 141 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:1.0:1715205775.050892:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594480/0xb608af43050055cc lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c5b expref: 141 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:1.0:1715205775.050902:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef7:0x0].0x0 (ffff88012c0eee00) 00010000:00010000:1.0:1715205775.050905:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ba80/0xb608af430500636a lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.050913:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ba80/0xb608af430500636a lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.050919:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ba80/0xb608af430500636a lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.050946:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205775.050991:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364a8e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+140:1830:x1798520455728192:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 150us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.050998:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4594 00000100:00100000:1.0:1715205775.053362:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455728320 00010000:00010000:1.0:1715205775.053378:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ba80/0xb608af430500636a lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230f3 expref: 142 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:1.0:1715205775.053399:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4595 00000100:00100000:1.0:1715205775.053403:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364a84c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+142:1830:x1798520455728320:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1715205775.053411:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.053414:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ba80/0xb608af430500636a lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230f3 expref: 142 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:1.0:1715205775.053425:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ba80/0xb608af430500636a lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230f3 expref: 142 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:1.0:1715205775.053438:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ba80/0xb608af430500636a lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230f3 expref: 142 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:1.0:1715205775.053446:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef7:0x0].0x0 (ffff88012c0eee00) 00010000:00010000:1.0:1715205775.053449:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5b840/0xb608af430500637f lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.053454:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5b840/0xb608af430500637f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.053459:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5b840/0xb608af430500637f lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.053480:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205775.053513:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364a84c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+141:1830:x1798520455728320:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 109us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.053518:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4595 00000100:00100000:1.0:1715205775.056476:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455728512 00010000:00010000:1.0:1715205775.056490:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050055ef lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c69 expref: 142 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:1.0:1715205775.056514:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4596 00000100:00100000:1.0:1715205775.056518:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364aaac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+142:1831:x1798520455728512:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1715205775.056525:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.056529:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050055ef lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c69 expref: 142 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:1.0:1715205775.056564:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050055ef lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c69 expref: 142 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:1.0:1715205775.056577:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050055ef lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c69 expref: 142 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:1.0:1715205775.056586:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef8:0x0].0x0 (ffff880091e4c900) 00010000:00010000:1.0:1715205775.056589:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ad00/0xb608af430500638d lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.056595:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ad00/0xb608af430500638d lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.056600:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ad00/0xb608af430500638d lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.056636:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205775.056744:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364aaac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+143:1831:x1798520455728512:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 226us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.056751:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4596 00000100:00100000:1.0:1715205775.059036:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455728640 00010000:00010000:1.0:1715205775.059047:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ad00/0xb608af430500638d lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23101 expref: 143 pid: 14185 timeout: 3134 lvb_type: 0 00000100:00100000:1.0:1715205775.059059:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4597 00000100:00100000:1.0:1715205775.059062:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7053050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+143:1830:x1798520455728640:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1715205775.059069:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.059071:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ad00/0xb608af430500638d lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23101 expref: 143 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:1.0:1715205775.059075:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ad00/0xb608af430500638d lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23101 expref: 143 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:1.0:1715205775.059083:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ad00/0xb608af430500638d lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23101 expref: 143 pid: 14185 timeout: 3134 lvb_type: 0 00010000:00010000:1.0:1715205775.059090:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef8:0x0].0x0 (ffff880091e4c900) 00010000:00010000:1.0:1715205775.059091:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59b00/0xb608af43050063a2 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.059095:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59b00/0xb608af43050063a2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.059098:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59b00/0xb608af43050063a2 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.059112:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205775.059130:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7053050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+142:1830:x1798520455728640:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 67us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.059134:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4597 00000100:00100000:1.0:1715205775.060786:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.061776:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.061832:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455728832 00010000:00010000:1.0:1715205775.061845:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305005612 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c77 expref: 143 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.061870:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4598 00000100:00100000:1.0:1715205775.061874:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+143:1830:x1798520455728832:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1715205775.061880:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.061883:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305005612 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c77 expref: 143 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.062056:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305005612 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c77 expref: 143 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.062071:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305005612 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c77 expref: 143 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.062080:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef9:0x0].0x0 (ffff88009bcc4a00) 00010000:00010000:1.0:1715205775.062082:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb58fc0/0xb608af43050063b0 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xef9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.062088:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb58fc0/0xb608af43050063b0 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xef9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.062093:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb58fc0/0xb608af43050063b0 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xef9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.062107:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205775.062125:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+142:1830:x1798520455728832:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 250us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.062131:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4598 00000100:00100000:1.0:1715205775.063137:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.065661:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.068197:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.069532:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.070989:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.074471:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.076359:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.077481:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.079519:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.080946:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.083251:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.085744:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.087371:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.088670:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:1.0:1715205775.088865:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006443 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.088872:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006443 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205775.088883:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee0:0x0]: returning size 260096 00010000:00010000:1.0:1715205775.088959:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af430500643c lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23147 expref: 148 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.088969:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006443 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23147 expref: 147 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.088974:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee0:0x0].0x0 (ffff88012d4a6d00) 00010000:00010000:1.0:1715205775.088977:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205775.088978:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c2640, rc 0) 00010000:00000080:1.0:1715205775.088990:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce7b900 x1798520455729856/t330712482505(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.089026:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+147:11754:x1798520455729856:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1592us (1657us total) trans 330712482505 rc 0/0 00000100:00100000:1.0:1715205775.089031:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1655 00000100:00100000:1.0:1715205775.089920:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.091542:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455730048 00010000:00010000:3.0:1715205775.091562:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006443 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23147 expref: 149 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.091584:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4603 00000100:00100000:3.0:1715205775.091588:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d446d40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+149:1831:x1798520455730048:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1715205775.091596:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.091599:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006443 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23147 expref: 149 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.091607:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006443 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23147 expref: 149 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.091638:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006443 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23147 expref: 149 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.091646:0:19709:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee0:0x0].0x0 (ffff88012d4a6d00) 00010000:00010000:3.0:1715205775.091648:0:19709:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59200/0xb608af4305006458 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.091653:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59200/0xb608af4305006458 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.091658:0:19709:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59200/0xb608af4305006458 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.091678:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.091710:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d446d40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+148:1831:x1798520455730048:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 121us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.091716:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4603 00000100:00100000:3.0:1715205775.095482:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.097288:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.098783:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.100213:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.101668:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.103718:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.105316:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1715205775.105682:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb58000/0xb608af43050064c1 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.105691:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb58000/0xb608af43050064c1 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205775.105703:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee2:0x0]: returning size 260096 00010000:00010000:3.0:1715205775.105812:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb58240/0xb608af43050064ba lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23171 expref: 152 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.105824:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb58000/0xb608af43050064c1 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23171 expref: 151 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.105830:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee2:0x0].0x0 (ffff88012d4a6400) 00010000:00010000:3.0:1715205775.105832:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1715205775.105834:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012fb58000, rc 0) 00010000:00000080:3.0:1715205775.105837:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce7aac0 x1798520455730624/t330712482507(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.105874:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:11754:x1798520455730624:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2004us (2160us total) trans 330712482507 rc 0/0 00000100:00100000:3.0:1715205775.105881:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1661 00000100:00100000:1.0:1715205775.106944:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.107015:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455730752 00000100:00100000:3.0:1715205775.107048:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1662 00000100:00100000:3.0:1715205775.107052:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce78e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:11754:x1798520455730752:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.107065:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.107073:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050064cf lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23178 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.107104:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050064d6 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.107113:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb58000/0xb608af43050064c1 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23171 expref: 152 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.107118:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050064d6 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.107136:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb58000/0xb608af43050064c1 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23171 expref: 152 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.107144:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb58000/0xb608af43050064c1 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23171 expref: 152 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.107151:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456023488:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205775.107195:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f2840 going to sleep for 6 seconds 00000100:00100000:3.0:1715205775.108665:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456023488:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205775.108681:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050064d6 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.108930:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050064d6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.108938:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050064d6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205775.108966:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee2:0x0]: returning size 260096 00000004:00200000:3.0:1715205775.108969:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205775.108979:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050064d6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.108987:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050064d6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.109003:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050064cf lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23178 expref: 152 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.109018:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050064d6 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23178 expref: 151 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.109023:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee2:0x0].0x0 (ffff88012d4a6400) 00010000:00010000:3.0:1715205775.109024:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205775.109025:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ae400, rc 0) 00010000:00000080:3.0:1715205775.109029:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce78e40 x1798520455730752/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.109068:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce78e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:11754:x1798520455730752:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2015us (2126us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.109075:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1662 00000100:00100000:3.0:1715205775.110250:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455730880 00000100:00100000:3.0:1715205775.110281:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1663 00000100:00100000:3.0:1715205775.110285:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364adf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:11754:x1798520455730880:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.110295:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.110303:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af43050064dd lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2317f expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110331:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050064e4 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110343:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050064e4 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110350:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050064e4 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110360:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af43050064eb lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x862169a1 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110366:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af43050064eb lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110371:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af43050064eb lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110540:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050064f2 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110546:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050064f2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110552:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050064f2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205775.110564:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee3:0x0]: returning size 260096 00000004:00200000:3.0:1715205775.110566:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205775.110573:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050064f2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110580:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050064f2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110585:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050064e4 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110590:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050064e4 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110594:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050064e4 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110599:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73af840 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.110602:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050064e4 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110607:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050064e4 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110613:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205775.110615:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.110642:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050064e4 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110646:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050064e4 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110655:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af43050064eb lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110660:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af43050064eb lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110668:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af43050064eb lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110672:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73acb40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.110673:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af43050064eb lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110677:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af43050064eb lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110683:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x862169a1 (ffff88009399ea00) 00010000:00010000:3.0:1715205775.110685:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.110686:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af43050064eb lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110690:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af43050064eb lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110715:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af43050064dd lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2317f expref: 153 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110724:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050064f2 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2317f expref: 152 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.110729:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee3:0x0].0x0 (ffff88009399ee00) 00010000:00010000:3.0:1715205775.110731:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205775.110732:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73af180, rc 0) 00010000:00000080:3.0:1715205775.110736:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364adf00 x1798520455730880/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.110792:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364adf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+152:11754:x1798520455730880:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 506us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.110798:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1663 00000100:00100000:3.0:1715205775.112430:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455731008 00000100:00100000:3.0:1715205775.112460:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1664 00000100:00100000:3.0:1715205775.112464:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364ab900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+152:11754:x1798520455731008:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.112474:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.112483:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af43050064f9 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23186 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.112542:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006500 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.112552:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050064f2 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2317f expref: 153 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.112557:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006500 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.112580:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050064f2 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2317f expref: 153 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.112589:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050064f2 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2317f expref: 153 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.112598:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456023552:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205775.112661:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f2480 going to sleep for 6 seconds 00000100:00100000:1.0:1715205775.113960:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.114008:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456023552:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205775.114025:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006500 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.114202:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006500 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.114208:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006500 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205775.114220:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee3:0x0]: returning size 260096 00010000:00010000:3.0:1715205775.114313:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af43050064f9 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23186 expref: 154 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.114322:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006500 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23186 expref: 153 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.114327:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee3:0x0].0x0 (ffff88009399ee00) 00010000:00010000:3.0:1715205775.114329:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1715205775.114330:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ae640, rc 0) 00010000:00000080:3.0:1715205775.114334:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364ab900 x1798520455731008/t330712482508(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.114370:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364ab900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:11754:x1798520455731008:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1904us (2013us total) trans 330712482508 rc 0/0 00000100:00100000:3.0:1715205775.114375:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1664 00000100:00100000:1.0:1715205775.115398:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.115487:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455731136 00000100:00100000:3.0:1715205775.115731:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1665 00000100:00100000:3.0:1715205775.115735:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce78980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:11754:x1798520455731136:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.115750:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.115769:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af430500650e lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2318d expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.115801:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305006515 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.115810:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006500 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23186 expref: 154 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.115814:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305006515 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.115832:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006500 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23186 expref: 154 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.115838:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006500 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23186 expref: 154 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.115845:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456023616:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205775.115876:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f2480 going to sleep for 6 seconds 00000100:00100000:3.0:1715205775.117202:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456023616:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205775.117214:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305006515 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.117513:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1715205775.117783:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305006515 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.117788:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305006515 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205775.117813:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee3:0x0]: returning size 260096 00000004:00200000:3.0:1715205775.117816:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205775.117826:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305006515 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.117833:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305006515 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.117847:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af430500650e lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2318d expref: 154 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.117882:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305006515 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2318d expref: 153 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.117887:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee3:0x0].0x0 (ffff88009399ee00) 00010000:00010000:3.0:1715205775.117889:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205775.117891:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73af600, rc 0) 00010000:00000080:3.0:1715205775.117894:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce78980 x1798520455731136/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.117951:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce78980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:11754:x1798520455731136:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2215us (2554us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.117957:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1665 00000100:00100000:1.0:1715205775.119084:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.119144:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455731264 00000100:00100000:3.0:1715205775.119179:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1666 00000100:00100000:3.0:1715205775.119183:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:11754:x1798520455731264:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.119196:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.119212:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af430500651c lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23194 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.119250:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006523 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.119259:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006523 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.119265:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006523 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.119273:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af430500652a lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x85ed8f9c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.119276:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af430500652a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.119280:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af430500652a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.119351:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006523 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.119355:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006523 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.119360:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006523 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.119365:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73adb00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.119369:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006523 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.119374:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006523 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.119383:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205775.119385:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.119388:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006523 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.119393:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006523 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.119404:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af430500652a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.119409:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af430500652a lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.119413:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af430500652a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.119416:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ac000 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.119418:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af430500652a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.119422:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af430500652a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.119427:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x85ed8f9c (ffff88009399e900) 00010000:00010000:3.0:1715205775.119430:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.119431:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af430500652a lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.119435:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af430500652a lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.119470:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af430500651c lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23194 expref: 154 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.119476:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af430500651c lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23194 expref: 154 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.119483:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ad8c0, rc 0) 00010000:00000080:3.0:1715205775.119486:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce7e880 x1798520455731264/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.119530:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:11754:x1798520455731264:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 346us (451us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205775.119536:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1666 00000100:00100000:3.0:1715205775.120503:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455731328 00000100:00100000:3.0:1715205775.120547:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1667 00000100:00100000:3.0:1715205775.120552:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364a8e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:11754:x1798520455731328:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.120648:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.120664:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af4305006531 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2319b expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.120701:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305006538 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.120715:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305006538 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.120722:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305006538 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.120733:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af430500653f lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.120738:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af430500653f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.120743:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af430500653f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.120830:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305006538 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.120837:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305006538 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.120841:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305006538 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.120847:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73aef40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.120849:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305006538 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.120855:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305006538 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.120863:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205775.120865:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.120867:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305006538 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.120871:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305006538 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.120880:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af430500653f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.120885:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af430500653f lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.120889:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af430500653f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.120893:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73acb40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.120895:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af430500653f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.120899:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af430500653f lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.120904:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0xec6f74b7 (ffff88009399e800) 00010000:00010000:3.0:1715205775.120906:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.120907:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af430500653f lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.120915:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af430500653f lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.120952:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af4305006531 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2319b expref: 154 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.120957:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af4305006531 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2319b expref: 154 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.120965:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73af180, rc 0) 00010000:00000080:3.0:1715205775.120969:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364a8e40 x1798520455731328/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.121016:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364a8e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:11754:x1798520455731328:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 463us (605us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205775.121022:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1667 00000100:00100000:1.0:1715205775.122217:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.122288:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455731392 00000100:00100000:3.0:1715205775.122321:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1668 00000100:00100000:3.0:1715205775.122325:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:11754:x1798520455731392:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.122332:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.122340:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305006546 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b231a2 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.122362:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af430500654d lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.122374:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af430500654d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.122380:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af430500654d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.122389:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006554 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xd13416e1 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.122394:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006554 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.122399:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006554 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.122432:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af430500654d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.122437:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af430500654d lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.122442:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af430500654d lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.122446:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ac480 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.122448:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af430500654d lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.122452:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af430500654d lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.122458:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205775.122460:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.122462:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af430500654d lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.122466:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af430500654d lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.122475:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006554 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.122480:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006554 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.122484:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006554 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.122487:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ad200 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.122489:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006554 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.122493:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006554 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.122498:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0xd13416e1 (ffff88009399ef00) 00010000:00010000:3.0:1715205775.122500:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.122501:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006554 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.122505:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006554 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.122538:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305006546 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231a2 expref: 154 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.122544:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305006546 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231a2 expref: 154 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.122551:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73af840, rc 0) 00010000:00000080:3.0:1715205775.122553:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce7c740 x1798520455731392/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.122592:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:11754:x1798520455731392:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 267us (378us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205775.122598:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1668 00000100:00100000:1.0:1715205775.124073:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.124119:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455731456 00000100:00100000:3.0:1715205775.124137:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1669 00000100:00100000:3.0:1715205775.124141:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:11754:x1798520455731456:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.124149:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.124155:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af430500655b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b231a9 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.124176:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305006562 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.124183:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305006562 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.124189:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305006562 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.124197:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006569 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x2253fa11 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.124201:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006569 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.124204:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006569 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.124231:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305006562 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.124234:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305006562 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.124236:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305006562 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.124239:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ae880 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.124240:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305006562 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.124243:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305006562 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.124246:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205775.124248:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.124249:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305006562 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.124254:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305006562 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.124260:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006569 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.124262:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006569 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.124265:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006569 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.124268:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73acfc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.124268:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006569 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.124271:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006569 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.124273:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x2253fa11 (ffff88009399e000) 00010000:00010000:3.0:1715205775.124274:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.124275:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006569 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.124277:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006569 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.124296:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af430500655b lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231a9 expref: 154 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.124302:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af430500655b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231a9 expref: 154 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.124306:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73adf80, rc 0) 00010000:00000080:3.0:1715205775.124309:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce7af80 x1798520455731456/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.124339:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:11754:x1798520455731456:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 198us (269us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205775.124345:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1669 00000100:00100000:3.0:1715205775.126182:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455731584 00000100:00100000:3.0:1715205775.126213:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1670 00000100:00100000:3.0:1715205775.126217:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364a84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:11754:x1798520455731584:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.126225:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.126226:0:14185:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1715205775.126239:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5b600/0xb608af43050063e1 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23124 expref: 153 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.126250:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205775.126252:0:14185:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205775.126258:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305006570 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b231b0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.126328:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305006577 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.126335:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305006577 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.126342:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305006577 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.126351:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af430500657e lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x2253fa11 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.126355:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af430500657e lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.126360:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af430500657e lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715205775.126688:0:14185:0:(osp_object.c:1645:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x100010000:0x15d6:0x0], index 1: 0 00010000:00010000:3.0:1715205775.126902:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305006585 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.126909:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305006585 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.126915:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305006585 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.126936:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305006577 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.126941:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305006577 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.126945:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305006577 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.126951:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73aeac0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.126953:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305006577 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.126957:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305006577 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.126963:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205775.126965:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.126967:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305006577 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.126971:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305006577 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715205775.126978:0:14185:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff8801364a84c0 reply state ffff8800919f6000 transno 330712482509 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af430500657e lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.126994:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305006570 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231b0 expref: 155 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.127005:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305006585 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231b0 expref: 154 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.127010:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100a:0x0].0x0 (ffff88009399eb00) 00010000:00010000:3.0:1715205775.127012:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1715205775.127012:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ac240, rc 0) 00010000:00000080:3.0:1715205775.127015:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364a84c0 x1798520455731584/t330712482509(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 656/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.127060:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364a84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+155:11754:x1798520455731584:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 842us (931us total) trans 330712482509 rc 0/0 00000100:00100000:3.0:1715205775.127066:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1670 00000100:00100000:3.0:1715205775.129854:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455731648 00000100:00100000:3.0:1715205775.129897:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1671 00000100:00100000:3.0:1715205775.129902:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364aaac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+154:11754:x1798520455731648:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.129921:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.129933:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305006593 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b231b7 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.129977:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500659a lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.129986:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500659a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.129993:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500659a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205775.130020:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205775.130031:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500659a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.130037:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500659a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.130050:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305006593 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231b7 expref: 156 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.130067:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500659a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231b7 expref: 155 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.130072:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100a:0x0].0x0 (ffff88009399eb00) 00010000:00010000:3.0:1715205775.130074:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205775.130075:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73acd80, rc 0) 00010000:00000080:3.0:1715205775.130078:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364aaac0 x1798520455731648/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.130121:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364aaac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+155:11754:x1798520455731648:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 219us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.130125:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1671 00000100:00100000:1.0:1715205775.130953:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.132372:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.134893:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455731968 00000100:00100000:3.0:1715205775.134935:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1672 00000100:00100000:3.0:1715205775.134940:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d440e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455731968:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.134956:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.134971:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af43050065a8 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b231c5 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.135051:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af43050065af lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.135063:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500659a lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231b7 expref: 157 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.135070:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af43050065af lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.135105:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500659a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231b7 expref: 157 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.135115:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500659a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231b7 expref: 157 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.135126:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456023680:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205775.135176:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f2e40 going to sleep for 6 seconds 00000100:00100000:3.0:1715205775.136159:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456023680:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205775.136176:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af43050065af lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.136516:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af43050065af lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.136522:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af43050065af lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205775.136535:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x100a:0x0]: returning size 0 00010000:00010000:3.0:1715205775.136655:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af43050065a8 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231c5 expref: 158 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.136667:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af43050065af lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231c5 expref: 157 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.136673:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100a:0x0].0x0 (ffff88009399eb00) 00010000:00010000:3.0:1715205775.136675:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1715205775.136677:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73adf80, rc 0) 00010000:00000080:3.0:1715205775.136680:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d440e40 x1798520455731968/t330712482511(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.136713:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d440e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+157:11754:x1798520455731968:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1773us (1889us total) trans 330712482511 rc 0/0 00000100:00100000:3.0:1715205775.136719:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1672 00000100:00100000:3.0:1715205775.137748:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455732096 00000100:00100000:3.0:1715205775.137785:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1673 00000100:00100000:3.0:1715205775.137789:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+157:11754:x1798520455732096:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.137800:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.137808:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050065bd lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b231cc expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.137841:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af43050065c4 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.137850:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af43050065af lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231c5 expref: 158 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.137856:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af43050065c4 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.137873:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af43050065af lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231c5 expref: 158 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.137882:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af43050065af lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231c5 expref: 158 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.137891:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456023744:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205775.137927:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f2e40 going to sleep for 6 seconds 00000100:00100000:3.0:1715205775.138551:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456023744:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205775.138562:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af43050065c4 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.138826:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af43050065c4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.138834:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af43050065c4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205775.138855:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x100a:0x0]: returning size 0 00000004:00200000:3.0:1715205775.138858:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205775.138869:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af43050065c4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.138876:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af43050065c4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.138888:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050065bd lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231cc expref: 158 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.138899:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af43050065c4 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231cc expref: 157 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.138904:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100a:0x0].0x0 (ffff88009399eb00) 00010000:00010000:3.0:1715205775.138906:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205775.138907:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ae880, rc 0) 00010000:00000080:3.0:1715205775.138911:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013711d0c0 x1798520455732096/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.138931:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+157:11754:x1798520455732096:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1141us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.138936:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1673 00000100:00100000:1.0:1715205775.140014:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.141361:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.142888:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455732352 00000100:00100000:3.0:1715205775.142929:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1674 00000100:00100000:3.0:1715205775.142933:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+157:11754:x1798520455732352:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.142946:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.142958:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050065d2 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b231da expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.142998:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050065d9 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.143007:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050065d9 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.143014:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050065d9 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.143025:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050065e0 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x19f5fa5d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.143030:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050065e0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.143034:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050065e0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.143103:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050065d9 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.143109:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050065d9 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.143114:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050065d9 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.143118:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ad200 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.143122:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050065d9 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.143127:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050065d9 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.143135:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205775.143137:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.143140:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050065d9 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.143144:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050065d9 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.143156:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050065e0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.143161:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050065e0 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.143169:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050065e0 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.143174:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ac480 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.143175:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050065e0 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.143180:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050065e0 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.143186:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x19f5fa5d (ffff88009399e000) 00010000:00010000:3.0:1715205775.143187:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.143188:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050065e0 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.143193:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050065e0 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.143229:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050065d2 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231da expref: 158 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.143235:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050065d2 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231da expref: 158 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.143242:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73af840, rc 0) 00010000:00000080:3.0:1715205775.143246:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013711f6c0 x1798520455732352/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.143286:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+157:11754:x1798520455732352:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 351us (462us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205775.143292:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1674 00000100:00100000:1.0:1715205775.144030:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.144070:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455732416 00000100:00100000:3.0:1715205775.144096:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1675 00000100:00100000:3.0:1715205775.144100:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+157:11754:x1798520455732416:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.144107:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.144114:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050065e7 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b231e1 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.144129:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050065e7 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231e1 expref: 158 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.144136:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050065e7 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231e1 expref: 158 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.144141:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205775.144143:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.144144:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73af180, rc 0) 00010000:00000080:3.0:1715205775.144147:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce7f200 x1798520455732416/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 328/344 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.144183:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+158:11754:x1798520455732416:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 82us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.144188:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1675 00000100:00100000:1.0:1715205775.145238:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.150248:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.150333:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455732608 00000100:00100000:3.0:1715205775.150376:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1676 00000100:00100000:3.0:1715205775.150382:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6faf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+158:11754:x1798520455732608:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.150397:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.150400:0:14185:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1715205775.150424:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050065e7 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231e1 expref: 158 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.150438:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205775.150441:0:14185:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205775.150449:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af43050065ee lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b231e8 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.150581:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af43050065f5 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.150593:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af43050065f5 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.150601:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af43050065f5 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.150613:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050065fc lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x19f5fa5d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.150642:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050065fc lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.150647:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050065fc lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715205775.150995:0:14185:0:(osp_object.c:1645:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x100000000:0x17b6:0x0], index 0: 0 00010000:00010000:3.0:1715205775.151118:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006603 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.151128:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006603 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.151134:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006603 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.151157:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af43050065f5 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.151162:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af43050065f5 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.151167:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af43050065f5 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.151171:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73aef40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.151173:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af43050065f5 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.151178:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af43050065f5 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.151183:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205775.151184:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.151186:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af43050065f5 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.151190:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af43050065f5 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715205775.151201:0:14185:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88009e6faf80 reply state ffff88009c2c3000 transno 330712482512 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050065fc lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.151219:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af43050065ee lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231e8 expref: 160 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.151230:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006603 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231e8 expref: 159 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.151235:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100b:0x0].0x0 (ffff88009399e700) 00010000:00010000:3.0:1715205775.151237:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1715205775.151238:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ac000, rc 0) 00010000:00000080:3.0:1715205775.151242:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6faf80 x1798520455732608/t330712482512(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 656/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.151304:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6faf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+160:11754:x1798520455732608:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 922us (1060us total) trans 330712482512 rc 0/0 00000100:00100000:3.0:1715205775.151310:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1676 00000100:00100000:1.0:1715205775.152745:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.152827:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455732672 00000100:00100000:3.0:1715205775.152865:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1677 00000100:00100000:3.0:1715205775.152870:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+159:11754:x1798520455732672:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.152890:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.152899:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006611 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b231ef expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.152939:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af4305006618 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.152951:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af4305006618 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.152958:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af4305006618 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205775.152978:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205775.152988:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af4305006618 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.152996:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af4305006618 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.153010:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006611 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231ef expref: 161 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.153020:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af4305006618 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231ef expref: 160 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.153025:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100b:0x0].0x0 (ffff88009399e700) 00010000:00010000:3.0:1715205775.153027:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205775.153028:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73afcc0, rc 0) 00010000:00000080:3.0:1715205775.153031:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6fda40 x1798520455732672/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.153075:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+160:11754:x1798520455732672:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 205us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.153081:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1677 00000100:00100000:1.0:1715205775.154108:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.157458:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.157536:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455732992 00000100:00100000:3.0:1715205775.157581:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1678 00000100:00100000:3.0:1715205775.157609:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fa140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+161:11754:x1798520455732992:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.157675:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.157691:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305006626 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b231fd expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.157798:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af430500662d lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.157810:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af4305006618 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231ef expref: 162 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.157815:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af430500662d lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.157837:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af4305006618 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231ef expref: 162 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.157844:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af4305006618 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231ef expref: 162 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.157852:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456023936:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205775.157901:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f2a80 going to sleep for 6 seconds 00000100:00100000:3.0:1715205775.158790:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456023936:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205775.158805:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af430500662d lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.158821:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1715205775.159043:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af430500662d lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.159049:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af430500662d lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205775.159060:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x100b:0x0]: returning size 0 00010000:00010000:3.0:1715205775.159146:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305006626 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231fd expref: 163 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.159158:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af430500662d lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231fd expref: 162 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.159163:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100b:0x0].0x0 (ffff88009399e700) 00010000:00010000:3.0:1715205775.159166:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1715205775.159167:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ae640, rc 0) 00010000:00000080:3.0:1715205775.159171:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6fa140 x1798520455732992/t330712482514(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.159206:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fa140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:11754:x1798520455732992:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1597us (1752us total) trans 330712482514 rc 0/0 00000100:00100000:3.0:1715205775.159213:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1678 00000100:00100000:1.0:1715205775.160295:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.160331:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455733120 00000100:00100000:3.0:1715205775.160350:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1679 00000100:00100000:3.0:1715205775.160353:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:11754:x1798520455733120:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.160363:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.160370:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af430500663b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23204 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.160395:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006642 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.160403:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af430500662d lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231fd expref: 163 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.160408:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006642 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.160423:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af430500662d lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231fd expref: 163 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.160429:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af430500662d lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231fd expref: 163 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.160436:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456024000:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205775.160467:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f2a80 going to sleep for 6 seconds 00000100:00100000:3.0:1715205775.161294:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456024000:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205775.161305:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006642 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.161308:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1715205775.161565:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006642 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.161572:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006642 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205775.161592:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x100b:0x0]: returning size 0 00000004:00200000:3.0:1715205775.161595:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205775.161604:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006642 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.161612:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006642 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.161642:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af430500663b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23204 expref: 163 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.162204:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006642 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23204 expref: 162 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.162212:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100b:0x0].0x0 (ffff88009399e700) 00010000:00010000:3.0:1715205775.162214:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205775.162216:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73adb00, rc 0) 00010000:00000080:3.0:1715205775.162219:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6f9300 x1798520455733120/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.162254:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:11754:x1798520455733120:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1899us (1961us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.162260:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1679 00000100:00100000:1.0:1715205775.163381:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.164793:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.164853:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455733312 00010000:00010000:3.0:1715205775.164871:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1f80/0xb608af430500661f lrc: 4/0,0 mode: PR/PR res: [0x17b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231f6 expref: 52 pid: 19955 timeout: 3135 lvb_type: 1 00000100:00100000:3.0:1715205775.164896:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4615 00000100:00100000:3.0:1715205775.164900:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6ff200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+52:1830:x1798520455733312:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1715205775.164909:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.164922:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1f80/0xb608af430500661f lrc: 4/0,0 mode: PR/PR res: [0x17b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231f6 expref: 52 pid: 19955 timeout: 3135 lvb_type: 1 00010000:00010000:3.0:1715205775.164935:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1f80/0xb608af430500661f lrc: 3/0,0 mode: PR/PR res: [0x17b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231f6 expref: 52 pid: 19955 timeout: 3135 lvb_type: 1 00010000:00010000:3.0:1715205775.164950:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1f80/0xb608af430500661f lrc: 0/0,0 mode: --/PR res: [0x17b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231f6 expref: 52 pid: 19955 timeout: 3135 lvb_type: 1 00010000:00010000:3.0:1715205775.164958:0:19709:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205775.164959:0:19709:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205775.164963:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b8c3600/0xb608af4305006649 lrc: 2/0,0 mode: PW/PW res: [0x17b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2320b expref: 51 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.164970:0:19709:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8c3600/0xb608af4305006649 lrc: 3/0,0 mode: PW/PW res: [0x17b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2320b expref: 51 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.164990:0:19709:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b8c3600/0xb608af4305006649 lrc: 3/0,0 mode: PW/PW res: [0x17b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2320b expref: 51 pid: 19955 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.164998:0:19709:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:19709:1798520456024128:192.168.204.8@tcp:105: 00000100:00100000:3.0:1715205775.165025:0:19709:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f2a80 going to sleep for 6 seconds 00000100:00100000:3.0:1715205775.166535:0:19709:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:19709:1798520456024128:192.168.204.8@tcp:105: 00010000:00010000:3.0:1715205775.166548:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.166579:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6ff200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+51:1830:x1798520455733312:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 1677us (1786us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.166585:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4615 00000100:00100000:1.0:1715205775.168746:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.168835:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455733568 00000100:00100000:3.0:1715205775.168863:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1680 00000100:00100000:3.0:1715205775.168866:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fa600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+163:11754:x1798520455733568:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.168881:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.168893:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af4305006650 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23212 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.168957:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305006657 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.168969:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006642 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23204 expref: 164 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.168975:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305006657 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.168996:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006642 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23204 expref: 164 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.169005:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006642 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23204 expref: 164 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.169015:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456024192:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205775.169060:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f2a80 going to sleep for 6 seconds 00000100:00100000:3.0:1715205775.169915:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456024192:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205775.169926:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305006657 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.170058:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.170125:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455733632 00010000:00010000:3.0:1715205775.170139:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006642 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23204 expref: 165 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.170163:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4616 00000100:00100000:3.0:1715205775.170167:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+165:1831:x1798520455733632:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205775.170174:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.170177:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006642 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23204 expref: 165 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.170184:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006642 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23204 expref: 165 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.170195:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006642 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23204 expref: 165 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.170205:0:19709:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100b:0x0].0x0 (ffff88009399e700) 00010000:00010000:3.0:1715205775.170208:0:19709:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305006657 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.170213:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305006657 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.170218:0:19709:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305006657 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.170230:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.170266:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+164:1831:x1798520455733632:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 98us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.170271:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4616 00000100:00100000:1.0:1715205775.171234:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.172689:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.172735:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455733760 00010000:00010000:3.0:1715205775.172747:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305006657 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23212 expref: 166 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.172787:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4617 00000100:00100000:3.0:1715205775.172790:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fe880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+166:1830:x1798520455733760:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1715205775.172795:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.172798:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305006657 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23212 expref: 166 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.172803:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305006657 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23212 expref: 166 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.172812:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305006657 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23212 expref: 166 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.172824:0:19709:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100b:0x0].0x0 (ffff88009399e700) 00010000:00010000:3.0:1715205775.172827:0:19709:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0fc0/0xb608af430500666c lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.172832:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0fc0/0xb608af430500666c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.172837:0:19709:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0fc0/0xb608af430500666c lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.172863:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205775.172895:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0fc0/0xb608af430500666c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.172900:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0fc0/0xb608af430500666c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.172912:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fe880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+165:1830:x1798520455733760:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 121us (224us total) trans 0 rc 0/0 00000004:00200000:1.0:1715205775.172919:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x100b:0x0]: returning size 53 00000100:00100000:3.0:1715205775.172920:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4617 00000004:00200000:1.0:1715205775.172922:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205775.172932:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0fc0/0xb608af430500666c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.172938:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0fc0/0xb608af430500666c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.172951:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305006665 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23219 expref: 165 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.172962:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0fc0/0xb608af430500666c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23219 expref: 164 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.172967:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100b:0x0].0x0 (ffff88009399e700) 00010000:00010000:1.0:1715205775.172969:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205775.172970:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c0fc0, rc 0) 00010000:00000080:1.0:1715205775.172973:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6fc740 x1798520455733696/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.172999:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fc740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+164:11754:x1798520455733696:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1685us (1767us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.173004:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1681 00000100:00100000:1.0:1715205775.174966:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.184739:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.186769:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455734336 00000100:00100000:3.0:1715205775.186816:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1687 00000100:00100000:3.0:1715205775.186821:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f623440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+166:11754:x1798520455734336:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.186839:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.186851:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af43050066dc lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23243 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.186901:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050066e3 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.186911:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050066e3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.186918:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050066e3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205775.186942:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205775.186950:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050066e3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.186956:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050066e3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.186968:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af43050066dc lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23243 expref: 168 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.186987:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050066e3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23243 expref: 167 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.186997:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100c:0x0].0x0 (ffff88012d4a6900) 00010000:00010000:3.0:1715205775.186999:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205775.187001:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73af180, rc 0) 00010000:00000080:3.0:1715205775.187004:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009f623440 x1798520455734336/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.187053:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f623440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455734336:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 231us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.187058:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1687 00000100:00100000:1.0:1715205775.189342:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.191440:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455734656 00000100:00100000:3.0:1715205775.191489:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1688 00000100:00100000:3.0:1715205775.191494:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f623900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+168:11754:x1798520455734656:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.191510:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.191523:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050066f1 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23251 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.191594:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050066f8 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.191607:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050066e3 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23243 expref: 169 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.191613:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050066f8 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.191667:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050066e3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23243 expref: 169 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.191681:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050066e3 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23243 expref: 169 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.191692:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456024320:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205775.191749:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f2a80 going to sleep for 6 seconds 00000100:00100000:3.0:1715205775.192656:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456024320:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205775.192676:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050066f8 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.193103:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455734720 00010000:00010000:3.0:1715205775.193125:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050066e3 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23243 expref: 170 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.193153:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4618 00000100:00100000:3.0:1715205775.193157:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7051850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+170:1831:x1798520455734720:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1715205775.193167:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.193172:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050066e3 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23243 expref: 170 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.193179:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050066e3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23243 expref: 170 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.193195:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050066e3 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23243 expref: 170 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.193215:0:19709:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100c:0x0].0x0 (ffff88012d4a6900) 00010000:00010000:3.0:1715205775.193218:0:19709:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050066f8 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.193225:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050066f8 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.193231:0:19709:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050066f8 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.193255:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.193289:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7051850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+169:1831:x1798520455734720:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 131us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.193295:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4618 00000100:00100000:3.0:1715205775.196566:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455734848 00010000:00010000:3.0:1715205775.196578:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050066f8 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23251 expref: 171 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.196595:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4619 00000100:00100000:3.0:1715205775.196598:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4450c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:1831:x1798520455734848:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1715205775.196603:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.196606:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050066f8 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23251 expref: 171 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.196611:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050066f8 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23251 expref: 171 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.196637:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050066f8 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23251 expref: 171 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.196651:0:19709:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100c:0x0].0x0 (ffff88012d4a6900) 00010000:00010000:3.0:1715205775.196653:0:19709:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af430500670d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.196658:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af430500670d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.196661:0:19709:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af430500670d lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.196677:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.196696:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4450c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+170:1831:x1798520455734848:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 98us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.196700:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4619 00000100:00100000:1.0:1715205775.199516:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.199567:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455734976 00010000:00010000:3.0:1715205775.199586:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fb5ad00/0xb608af43050066ea lrc: 4/0,0 mode: PR/PR res: [0x15d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2324a expref: 57 pid: 19955 timeout: 3135 lvb_type: 1 00000100:00100000:3.0:1715205775.199609:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4620 00000100:00100000:3.0:1715205775.199612:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f9c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+57:1830:x1798520455734976:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205775.199642:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.199656:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fb5ad00/0xb608af43050066ea lrc: 4/0,0 mode: PR/PR res: [0x15d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2324a expref: 57 pid: 19955 timeout: 3135 lvb_type: 1 00010000:00010000:3.0:1715205775.199664:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fb5ad00/0xb608af43050066ea lrc: 3/0,0 mode: PR/PR res: [0x15d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2324a expref: 57 pid: 19955 timeout: 3135 lvb_type: 1 00010000:00010000:3.0:1715205775.199683:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fb5ad00/0xb608af43050066ea lrc: 0/0,0 mode: --/PR res: [0x15d7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2324a expref: 57 pid: 19955 timeout: 3135 lvb_type: 1 00010000:00010000:3.0:1715205775.199691:0:19709:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205775.199692:0:19709:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205775.199697:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b8c2880/0xb608af4305006714 lrc: 2/0,0 mode: PW/PW res: [0x15d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2325f expref: 56 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.199703:0:19709:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8c2880/0xb608af4305006714 lrc: 3/0,0 mode: PW/PW res: [0x15d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2325f expref: 56 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.199718:0:19709:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b8c2880/0xb608af4305006714 lrc: 3/0,0 mode: PW/PW res: [0x15d7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2325f expref: 56 pid: 19955 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.199725:0:19709:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:19709:1798520456024512:192.168.204.8@tcp:105: 00000100:00100000:3.0:1715205775.199769:0:19709:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f23c0 going to sleep for 6 seconds 00000100:00100000:3.0:1715205775.200542:0:19709:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:19709:1798520456024512:192.168.204.8@tcp:105: 00010000:00010000:3.0:1715205775.200556:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.200580:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f9c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+56:1830:x1798520455734976:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 966us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.200585:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4620 00000100:00100000:1.0:1715205775.203353:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.204766:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d444280 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456024576:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205775.204794:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5af40/0xb608af4305006722 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.204823:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455735296 00010000:00010000:3.0:1715205775.204842:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af430500670d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23258 expref: 172 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.204874:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4621 00000100:00100000:3.0:1715205775.204879:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131479300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+172:1831:x1798520455735296:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1715205775.204889:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.204892:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af430500670d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23258 expref: 172 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.204899:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af430500670d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23258 expref: 172 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.204915:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af430500670d lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23258 expref: 172 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.204925:0:19709:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100c:0x0].0x0 (ffff88012d4a6900) 00010000:00010000:3.0:1715205775.204928:0:19709:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5af40/0xb608af4305006722 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.204934:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5af40/0xb608af4305006722 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.204940:0:19709:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5af40/0xb608af4305006722 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.204953:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.204994:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131479300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:1831:x1798520455735296:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 115us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.205000:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4621 00010000:00010000:3.0:1715205775.205014:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5af40/0xb608af4305006722 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.205018:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5af40/0xb608af4305006722 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205775.205032:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x100c:0x0]: returning size 53 00010000:00010000:3.0:1715205775.205134:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ba80/0xb608af430500671b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23266 expref: 172 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.205144:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5af40/0xb608af4305006722 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23266 expref: 171 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.205149:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100c:0x0].0x0 (ffff88012d4a6900) 00010000:00010000:3.0:1715205775.205151:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1715205775.205152:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012fb5af40, rc 0) 00010000:00000080:3.0:1715205775.205155:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6fb440 x1798520455735232/t330712482521(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.205185:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:11754:x1798520455735232:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1652us (1835us total) trans 330712482521 rc 0/0 00000100:00100000:3.0:1715205775.205191:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1690 00000100:00100000:3.0:1715205775.206393:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455735360 00000100:00100000:3.0:1715205775.206426:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1691 00000100:00100000:3.0:1715205775.206429:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c224c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:11754:x1798520455735360:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.206442:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.206452:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006730 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2326d expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.206486:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006737 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.206495:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5af40/0xb608af4305006722 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23266 expref: 172 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.206500:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006737 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.206522:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5af40/0xb608af4305006722 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23266 expref: 172 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.206554:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5af40/0xb608af4305006722 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23266 expref: 172 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.206563:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456024640:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205775.206604:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f23c0 going to sleep for 6 seconds 00000100:00100000:3.0:1715205775.207440:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456024640:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205775.207452:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006737 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.208046:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455735424 00010000:00010000:3.0:1715205775.208061:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5af40/0xb608af4305006722 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23266 expref: 173 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.208086:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4622 00000100:00100000:3.0:1715205775.208090:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d442ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+173:1830:x1798520455735424:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1715205775.208097:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.208100:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5af40/0xb608af4305006722 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23266 expref: 173 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.208107:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5af40/0xb608af4305006722 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23266 expref: 173 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.208118:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5af40/0xb608af4305006722 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23266 expref: 173 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.208129:0:19709:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100c:0x0].0x0 (ffff88012d4a6900) 00010000:00010000:3.0:1715205775.208132:0:19709:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006737 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.208138:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006737 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.208144:0:19709:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006737 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.208164:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.208208:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d442ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+172:1830:x1798520455735424:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 117us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.208214:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4622 00000100:00100000:1.0:1715205775.213879:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.219582:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.221428:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.224237:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.225886:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.228514:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.230509:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.233317:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1715205775.234202:0:11161:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715205775.234206:0:11161:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a1c0/0xb608af4305006784 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.234210:0:11161:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012fb5a1c0 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:3.0:1715205775.234213:0:11161:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a1c0/0xb608af4305006784 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.234217:0:11161:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a1c0/0xb608af4305006784 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.234223:0:11161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100b:0x0].0x0 (ffff88012d4a6000) 00010000:00010000:3.0:1715205775.234224:0:11161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715205775.234226:0:11161:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a1c0/0xb608af4305006784 lrc: 1/0,0 mode: --/PW res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.234229:0:11161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a1c0/0xb608af4305006784 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0x100b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.234250:0:11161:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715205775.234251:0:11161:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715205775.234252:0:11161:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715205775.235349:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.237306:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.239335:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.242923:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00000080:3.0:1715205775.245412:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6fc280 x1798520455737408/t0(0) o37->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 448/440 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.245459:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fc280 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+180:11754:x1798520455737408:12345-192.168.204.8@tcp:37:dbench.0 Request processed in 2287us (2539us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.245466:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 450 00000100:00100000:3.0:1715205775.248536:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455737600 00010000:00010000:3.0:1715205775.248552:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59200/0xb608af4305006458 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2314e expref: 182 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.248576:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4623 00000100:00100000:3.0:1715205775.248580:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b5f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+182:1830:x1798520455737600:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1715205775.248587:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.248590:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59200/0xb608af4305006458 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2314e expref: 182 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.248598:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59200/0xb608af4305006458 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2314e expref: 182 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.248610:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59200/0xb608af4305006458 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2314e expref: 182 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.248652:0:19709:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee0:0x0].0x0 (ffff88012d4a6d00) 00010000:00010000:3.0:1715205775.248659:0:19709:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a400/0xb608af43050067ca lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.248665:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a400/0xb608af43050067ca lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.248670:0:19709:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a400/0xb608af43050067ca lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.248689:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.248727:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b5f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+181:1830:x1798520455737600:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 146us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.248733:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4623 00000100:00100000:0.0:1715205775.250895:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.250943:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455737728 00010000:00010000:3.0:1715205775.250957:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a400/0xb608af43050067ca lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23297 expref: 183 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.250981:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4624 00000100:00100000:3.0:1715205775.250985:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+183:1831:x1798520455737728:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205775.250992:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.250996:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a400/0xb608af43050067ca lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23297 expref: 183 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.251003:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a400/0xb608af43050067ca lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23297 expref: 183 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.251013:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a400/0xb608af43050067ca lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23297 expref: 183 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.251021:0:19709:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee0:0x0].0x0 (ffff88012d4a6d00) 00010000:00010000:3.0:1715205775.251024:0:19709:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a640/0xb608af43050067df lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.251029:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a640/0xb608af43050067df lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.251034:0:19709:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a640/0xb608af43050067df lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.251059:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.251106:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+182:1831:x1798520455737728:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 120us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.251114:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4624 00000100:00100000:0.0:1715205775.252546:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.254110:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.254162:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455737920 00000100:00100000:3.0:1715205775.254192:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 451 00000100:00100000:3.0:1715205775.254195:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fcc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+181:11754:x1798520455737920:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:3.0:1715205775.254294:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6fcc00 x1798520455737920/t330712482535(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.254327:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fcc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+182:11754:x1798520455737920:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 131us (218us total) trans 330712482535 rc 0/0 00000100:00100000:3.0:1715205775.254334:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 451 00000100:00100000:0.0:1715205775.255556:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.257036:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.257078:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455738112 00010000:00010000:3.0:1715205775.257093:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a640/0xb608af43050067df lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2329e expref: 184 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.257116:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4625 00000100:00100000:3.0:1715205775.257120:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7051050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+184:1831:x1798520455738112:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1715205775.257128:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.257131:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a640/0xb608af43050067df lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2329e expref: 184 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.257139:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a640/0xb608af43050067df lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2329e expref: 184 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.257150:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a640/0xb608af43050067df lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2329e expref: 184 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.257159:0:19709:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee0:0x0].0x0 (ffff88012d4a6d00) 00010000:00010000:3.0:1715205775.257162:0:19709:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5b600/0xb608af4305006802 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.257167:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5b600/0xb608af4305006802 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.257177:0:19709:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5b600/0xb608af4305006802 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.257196:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.257224:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7051050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+183:1831:x1798520455738112:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 103us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.257229:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4625 00000100:00100000:0.0:1715205775.258539:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.261177:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.261267:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455738240 00010000:00010000:3.0:1715205775.261311:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5b600/0xb608af4305006802 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232ac expref: 185 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.261349:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4626 00000100:00100000:3.0:1715205775.261353:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+185:1831:x1798520455738240:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1715205775.261363:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.261367:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5b600/0xb608af4305006802 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232ac expref: 185 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.261374:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5b600/0xb608af4305006802 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232ac expref: 185 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.261387:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5b600/0xb608af4305006802 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232ac expref: 185 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.261403:0:19709:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee0:0x0].0x0 (ffff88012d4a6d00) 00010000:00010000:3.0:1715205775.261405:0:19709:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb58d80/0xb608af4305006817 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.261412:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb58d80/0xb608af4305006817 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.261415:0:19709:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb58d80/0xb608af4305006817 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.261440:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.261473:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+184:1831:x1798520455738240:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 120us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.261477:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4626 00000100:00100000:0.0:1715205775.263465:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.264683:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.264724:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455738432 00010000:00010000:3.0:1715205775.264741:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb598c0/0xb608af4305006497 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23163 expref: 185 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.264775:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4627 00000100:00100000:3.0:1715205775.264779:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6dec740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+185:1831:x1798520455738432:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1715205775.264787:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.264790:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb598c0/0xb608af4305006497 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23163 expref: 185 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.264798:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb598c0/0xb608af4305006497 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23163 expref: 185 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.264815:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb598c0/0xb608af4305006497 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23163 expref: 185 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.264825:0:19709:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee1:0x0].0x0 (ffff880099676100) 00010000:00010000:3.0:1715205775.264828:0:19709:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a1c0/0xb608af4305006825 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.264840:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a1c0/0xb608af4305006825 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.264845:0:19709:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a1c0/0xb608af4305006825 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.264868:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.264896:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6dec740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+184:1831:x1798520455738432:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 116us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.264905:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4627 00000100:00100000:0.0:1715205775.266155:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.267507:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.267572:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455738560 00010000:00010000:3.0:1715205775.267588:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a1c0/0xb608af4305006825 lrc: 5/0,0 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232ba expref: 186 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.267641:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4628 00000100:00100000:3.0:1715205775.267645:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fd580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+186:1830:x1798520455738560:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205775.267652:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.267656:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a1c0/0xb608af4305006825 lrc: 5/0,0 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232ba expref: 186 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.267667:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a1c0/0xb608af4305006825 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232ba expref: 186 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.267679:0:19709:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee1:0x0].0x0 (ffff880099676100) 00010000:00010000:3.0:1715205775.267681:0:19709:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ad00/0xb608af430500683a lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.267687:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ad00/0xb608af430500683a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.267693:0:19709:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ad00/0xb608af430500683a lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.267704:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.267731:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fd580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+185:1830:x1798520455738560:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 86us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.267738:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4628 00000100:00100000:1.0:1715205775.269043:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.270440:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.270491:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455738752 00010000:00010000:3.0:1715205775.270506:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050064d6 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23178 expref: 186 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.270528:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4629 00000100:00100000:3.0:1715205775.270532:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+186:1831:x1798520455738752:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1715205775.270539:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.270542:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050064d6 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23178 expref: 186 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.270550:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050064d6 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23178 expref: 186 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.270559:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050064d6 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23178 expref: 186 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.270565:0:19709:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee2:0x0].0x0 (ffff88012d4a6400) 00010000:00010000:3.0:1715205775.270567:0:19709:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5af40/0xb608af4305006848 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.270571:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5af40/0xb608af4305006848 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.270574:0:19709:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5af40/0xb608af4305006848 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.270594:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.270675:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+185:1831:x1798520455738752:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 142us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.270680:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4629 00000100:00100000:1.0:1715205775.272026:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.273494:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.273587:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455738880 00010000:00010000:3.0:1715205775.273601:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5af40/0xb608af4305006848 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232c8 expref: 187 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.273653:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4630 00000100:00100000:3.0:1715205775.273657:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6ff200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:1831:x1798520455738880:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1715205775.273665:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.273669:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5af40/0xb608af4305006848 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232c8 expref: 187 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.273676:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5af40/0xb608af4305006848 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232c8 expref: 187 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.273687:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5af40/0xb608af4305006848 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232c8 expref: 187 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.273696:0:19709:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee2:0x0].0x0 (ffff88012d4a6400) 00010000:00010000:3.0:1715205775.273698:0:19709:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a640/0xb608af430500685d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.273703:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a640/0xb608af430500685d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.273708:0:19709:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a640/0xb608af430500685d lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.273734:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.273769:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6ff200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+186:1831:x1798520455738880:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 111us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.273775:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4630 00000100:00100000:1.0:1715205775.275711:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.277025:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.277080:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455739072 00010000:00010000:3.0:1715205775.277111:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305006515 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2318d expref: 187 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.277144:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4631 00000100:00100000:3.0:1715205775.277149:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fe880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:1831:x1798520455739072:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1715205775.277162:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.277166:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305006515 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2318d expref: 187 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.277175:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305006515 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2318d expref: 187 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.277191:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305006515 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2318d expref: 187 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.277208:0:19709:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee3:0x0].0x0 (ffff88009399ee00) 00010000:00010000:3.0:1715205775.277211:0:19709:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a880/0xb608af430500686b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.277219:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a880/0xb608af430500686b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.277225:0:19709:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a880/0xb608af430500686b lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.277261:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.277303:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fe880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+186:1831:x1798520455739072:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 153us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.277309:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4631 00000100:00100000:1.0:1715205775.278511:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.279873:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.279932:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455739200 00010000:00010000:3.0:1715205775.279947:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a880/0xb608af430500686b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232d6 expref: 188 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.279975:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4632 00000100:00100000:3.0:1715205775.279980:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7052050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+188:1831:x1798520455739200:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205775.279988:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.279991:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a880/0xb608af430500686b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232d6 expref: 188 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.279999:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a880/0xb608af430500686b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232d6 expref: 188 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.280010:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a880/0xb608af430500686b lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232d6 expref: 188 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.280019:0:19709:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee3:0x0].0x0 (ffff88009399ee00) 00010000:00010000:3.0:1715205775.280022:0:19709:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59440/0xb608af4305006880 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.280027:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59440/0xb608af4305006880 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.280033:0:19709:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59440/0xb608af4305006880 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.280057:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.280077:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7052050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:1831:x1798520455739200:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 97us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.280083:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4632 00000100:00100000:1.0:1715205775.282077:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.283767:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.283886:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455739392 00010000:00010000:3.0:1715205775.283903:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006737 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2326d expref: 188 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.283932:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4633 00000100:00100000:3.0:1715205775.283935:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+188:1831:x1798520455739392:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1715205775.283943:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.283947:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006737 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2326d expref: 188 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.283954:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006737 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2326d expref: 188 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.283967:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006737 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2326d expref: 188 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.283981:0:19709:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100c:0x0].0x0 (ffff88012d4a6900) 00010000:00010000:3.0:1715205775.283983:0:19709:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59200/0xb608af430500688e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.283989:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59200/0xb608af430500688e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.283994:0:19709:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59200/0xb608af430500688e lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.284020:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.284049:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:1831:x1798520455739392:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 112us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.284054:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4633 00000100:00100000:1.0:1715205775.285432:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.287347:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.287398:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455739520 00010000:00010000:3.0:1715205775.287416:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59200/0xb608af430500688e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232e4 expref: 189 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.287440:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4634 00000100:00100000:3.0:1715205775.287444:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fe880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+189:1830:x1798520455739520:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1715205775.287452:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.287455:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59200/0xb608af430500688e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232e4 expref: 189 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.287462:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59200/0xb608af430500688e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232e4 expref: 189 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.287474:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59200/0xb608af430500688e lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232e4 expref: 189 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.287485:0:19709:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100c:0x0].0x0 (ffff88012d4a6900) 00010000:00010000:3.0:1715205775.287488:0:19709:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5bcc0/0xb608af43050068a3 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.287494:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5bcc0/0xb608af43050068a3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.287499:0:19709:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5bcc0/0xb608af43050068a3 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.287521:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.287553:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fe880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+188:1830:x1798520455739520:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 108us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.287558:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4634 00000100:00100000:1.0:1715205775.289020:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.290313:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.291660:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.293212:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.294706:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.296113:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.297823:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.299122:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.300926:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.303408:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.304908:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.306802:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.306855:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455740608 00000100:00100000:3.0:1715205775.306891:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 452 00000100:00100000:3.0:1715205775.306895:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6deaac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+189:11754:x1798520455740608:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:3.0:1715205775.307109:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6deaac0 x1798520455740608/t330712482542(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.307143:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6deaac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+190:11754:x1798520455740608:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 247us (343us total) trans 330712482542 rc 0/0 00000100:00100000:3.0:1715205775.307148:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 452 00000100:00100000:1.0:1715205775.308333:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.310089:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.310170:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455740800 00010000:00010000:3.0:1715205775.310188:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af430500697c lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23331 expref: 192 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.310217:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4635 00000100:00100000:3.0:1715205775.310222:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1775f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+192:1831:x1798520455740800:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1715205775.310231:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.310234:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af430500697c lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23331 expref: 192 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.310243:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af430500697c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23331 expref: 192 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.310257:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af430500697c lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23331 expref: 192 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.310270:0:19709:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100d:0x0].0x0 (ffff88012c0ee800) 00010000:00010000:3.0:1715205775.310272:0:19709:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006991 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.310283:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006991 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.310288:0:19709:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006991 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.310313:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.310345:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1775f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+191:1831:x1798520455740800:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 122us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.310350:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4635 00000100:00100000:1.0:1715205775.311741:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.313914:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.313995:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455740928 00010000:00010000:3.0:1715205775.314021:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006991 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2333f expref: 193 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.314054:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4636 00000100:00100000:3.0:1715205775.314059:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1775580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+193:1830:x1798520455740928:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205775.314068:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.314072:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006991 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2333f expref: 193 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.314081:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006991 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2333f expref: 193 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.314148:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006991 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2333f expref: 193 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.314163:0:19709:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100d:0x0].0x0 (ffff88012c0ee800) 00010000:00010000:3.0:1715205775.314167:0:19709:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af43050069a6 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.314173:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af43050069a6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.314179:0:19709:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af43050069a6 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.314205:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.314243:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1775580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+192:1830:x1798520455740928:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 183us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.314249:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4636 00000100:00100000:1.0:1715205775.316612:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.318016:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.318103:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455741056 00010000:00010000:3.0:1715205775.318132:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800940c8d80/0xb608af4305006983 lrc: 4/0,0 mode: PR/PR res: [0x17b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23338 expref: 53 pid: 19955 timeout: 3135 lvb_type: 1 00000100:00100000:3.0:1715205775.318165:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4637 00000100:00100000:3.0:1715205775.318171:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a17704c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+53:1830:x1798520455741056:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1715205775.318181:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.318201:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800940c8d80/0xb608af4305006983 lrc: 4/0,0 mode: PR/PR res: [0x17b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23338 expref: 53 pid: 19955 timeout: 3135 lvb_type: 1 00010000:00010000:3.0:1715205775.318212:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800940c8d80/0xb608af4305006983 lrc: 3/0,0 mode: PR/PR res: [0x17b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23338 expref: 53 pid: 19955 timeout: 3135 lvb_type: 1 00010000:00010000:3.0:1715205775.318233:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800940c8d80/0xb608af4305006983 lrc: 0/0,0 mode: --/PR res: [0x17b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23338 expref: 53 pid: 19955 timeout: 3135 lvb_type: 1 00010000:00010000:3.0:1715205775.318251:0:19709:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205775.318253:0:19709:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205775.318259:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800940caf40/0xb608af43050069ad lrc: 2/0,0 mode: PW/PW res: [0x17b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2334d expref: 52 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.318267:0:19709:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800940caf40/0xb608af43050069ad lrc: 3/0,0 mode: PW/PW res: [0x17b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2334d expref: 52 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.318294:0:19709:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800940caf40/0xb608af43050069ad lrc: 3/0,0 mode: PW/PW res: [0x17b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2334d expref: 52 pid: 19955 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.318304:0:19709:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:19709:1798520456025664:192.168.204.8@tcp:105: 00000100:00100000:3.0:1715205775.318357:0:19709:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f29c0 going to sleep for 6 seconds 00000100:00100000:3.0:1715205775.319888:0:19709:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a66ded40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:19709:1798520456025664:192.168.204.8@tcp:105: 00010000:00010000:3.0:1715205775.319908:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.319943:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a17704c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+52:1830:x1798520455741056:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 1772us (1926us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.319951:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4637 00000100:00100000:1.0:1715205775.320183:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.320231:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455741184 00000100:00100000:3.0:1715205775.320258:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 453 00000100:00100000:3.0:1715205775.320261:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1772600 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+191:11754:x1798520455741184:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:3.0:1715205775.320507:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1772600 x1798520455741184/t330712482544(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.320543:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1772600 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+192:11754:x1798520455741184:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 281us (362us total) trans 330712482544 rc 0/0 00000100:00100000:3.0:1715205775.320550:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 453 00000100:00100000:1.0:1715205775.322436:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.324159:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.324859:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455741376 00010000:00010000:3.0:1715205775.324901:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af43050069a6 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23346 expref: 194 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.324942:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4638 00000100:00100000:3.0:1715205775.324947:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1773440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+194:1831:x1798520455741376:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1715205775.324961:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.324966:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af43050069a6 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23346 expref: 194 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.324975:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af43050069a6 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23346 expref: 194 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.324992:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af43050069a6 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23346 expref: 194 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.325005:0:19709:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100d:0x0].0x0 (ffff88012c0ee800) 00010000:00010000:3.0:1715205775.325008:0:19709:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af43050069bb lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.325016:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af43050069bb lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.325022:0:19709:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af43050069bb lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.325056:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.325113:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1773440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+193:1831:x1798520455741376:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 165us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.325120:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4638 00000100:00100000:0.0:1715205775.326215:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.327545:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.327643:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455741504 00010000:00010000:3.0:1715205775.327672:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af43050069bb lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23354 expref: 195 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.327706:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4639 00000100:00100000:3.0:1715205775.327711:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b521c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+195:1830:x1798520455741504:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1715205775.327721:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.327725:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af43050069bb lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23354 expref: 195 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.327733:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af43050069bb lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23354 expref: 195 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.327829:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af43050069bb lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23354 expref: 195 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.327841:0:19709:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100d:0x0].0x0 (ffff88012c0ee800) 00010000:00010000:3.0:1715205775.327844:0:19709:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af43050069d0 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.327851:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af43050069d0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.327855:0:19709:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af43050069d0 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.327879:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.327910:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b521c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+194:1830:x1798520455741504:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 199us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.327916:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4639 00000100:00100000:1.0:1715205775.329873:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.329969:0:7106:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455741568 00002000:00100000:3.0:1715205775.330001:0:7106:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x17b7:0x0] (0->4095) req@ffff8800a1775f00 x1798520455741568/t0(0) o4->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 4584/0 e 0 to 0 dl 1715205781 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dbench.0' 00002000:00100000:3.0:1715205775.330009:0:7106:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a1775f00 with x1798520455741568 ext(0->4095) 00002000:00010000:3.0:1715205775.330013:0:7106:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a1775f00 00000100:00100000:3.0:1715205775.330038:0:7106:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 737 00000100:00100000:3.0:1715205775.330042:0:7106:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1775f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+52:1831:x1798520455741568:12345-192.168.204.8@tcp:4:dbench.0 00000100:00100000:3.0:1715205775.330438:0:7106:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1775f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+54:1831:x1798520455741568:12345-192.168.204.8@tcp:4:dbench.0 Request processed in 394us (571us total) trans 30064771471 rc 0/0 00000100:00100000:3.0:1715205775.330444:0:7106:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 737 00002000:00100000:3.0:1715205775.330448:0:7106:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x100000000:0x17b7:0x0] (0->4095) req@ffff8800a1775f00 x1798520455741568/t30064771471(0) o4->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 4584/448 e 0 to 0 dl 1715205781 ref 1 fl Complete:/0/0 rc 0/0 job:'dbench.0' 00002000:00100000:3.0:1715205775.330455:0:7106:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a1775f00 with x1798520455741568 ext(0->4095) 00002000:00010000:3.0:1715205775.330462:0:7106:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a1775f00 00000100:00100000:1.0:1715205775.331491:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000001:00080000:1.0:1715205775.350222:0:14242:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-MDT0000: transno 330712482532 is committed 00000001:00080000:1.0:1715205775.350352:0:14242:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-MDT0000: transno 330712482545 is committed 00000004:00080000:1.0:1715205775.350371:0:14242:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:1.0:1715205775.350378:0:14242:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:3.0:1715205775.350490:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2852:1798520456025856:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1715205775.350542:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00000080:1.0:1715205775.350778:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1775580 x1798520455741632/t0(0) o44->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 448/440 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.350791:0:2851:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6de8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2851:1798520456026048:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715205775.350812:0:2851:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715205775.350817:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1775580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+100:11754:x1798520455741632:12345-192.168.204.8@tcp:44:dbench.0 Request processed in 19223us (19327us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.350824:0:2851:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6de84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2851:1798520456026304:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1715205775.350825:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1726 00000100:00100000:0.0:1715205775.350837:0:2851:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715205775.350847:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d441300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2854:1798520456025984:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715205775.350848:0:2851:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1715205775.350852:0:2851:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6de9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2851:1798520456026112:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715205775.350867:0:2851:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715205775.350884:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6de8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2853:1798520456025920:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715205775.350897:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715205775.350905:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6dedf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2853:1798520456026176:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715205775.350916:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1715205775.350940:0:19222:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456025856 00000100:00100000:1.0:1715205775.350946:0:11773:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456026048 00000100:00100000:0.0:1715205775.350963:0:19222:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456026304 00000100:00100000:3.0:1715205775.351154:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d4450c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2852:1798520456026368:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1715205775.351171:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715205775.351425:0:11773:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456026112 00000100:00100000:3.0:1715205775.351432:0:2852:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1715205775.351437:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009ce7ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2852:1798520456026560:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1715205775.351438:0:11773:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456025920 00000100:00100000:1.0:1715205775.351447:0:11773:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456026176 00000100:00100000:3.0:1715205775.351452:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715205775.351456:0:11773:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456026368 00000100:00100000:1.0:1715205775.351466:0:11773:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456026560 00000100:00100000:3.0:1715205775.351469:0:11771:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14666 00000100:00100000:3.0:1715205775.351472:0:11771:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66ded40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+65:2852:x1798520456025856:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1715205775.351476:0:11773:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14667 00000100:00100000:1.0:1715205775.351478:0:11773:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6de9c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+65:2851:x1798520456026048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1715205775.351488:0:11773:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:6067 count 1 00002000:00080000:3.0:1715205775.351488:0:11771:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:6064 count 1 00010000:00010000:1.0:1715205775.351503:0:11773:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b59f3c0/0xb608af43050069de lrc: 3/0,1 mode: --/PW res: [0x17b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.351503:0:11771:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a73acd80/0xb608af43050069d7 lrc: 3/0,1 mode: --/PW res: [0x17b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11771 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.351517:0:11773:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099173a80/0xb608af4305005d04 lrc: 2/0,0 mode: PW/PW res: [0x17b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22edf expref: 53 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.351517:0:11771:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1200/0xb608af430500536b lrc: 2/0,0 mode: PR/PR res: [0x17b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22b9e expref: 53 pid: 19955 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1715205775.351522:0:11773:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1715205775.351522:0:11771:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205775.351524:0:11773:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1715205775.351524:0:11771:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205775.351525:0:11773:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b59f3c0/0xb608af43050069de lrc: 4/0,1 mode: --/PW res: [0x17b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.351525:0:11771:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a73acd80/0xb608af43050069d7 lrc: 4/0,1 mode: --/PW res: [0x17b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11771 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.351541:0:11773:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099173a80/0xb608af4305005d04 lrc: 3/0,0 mode: PW/PW res: [0x17b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22edf expref: 53 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.351541:0:11771:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1200/0xb608af430500536b lrc: 3/0,0 mode: PR/PR res: [0x17b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22b9e expref: 53 pid: 19955 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1715205775.351550:0:11773:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099173a80/0xb608af4305005d04 lrc: 4/0,0 mode: PW/PW res: [0x17b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22edf expref: 53 pid: 19955 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.351550:0:11771:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1200/0xb608af430500536b lrc: 4/0,0 mode: PR/PR res: [0x17b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22b9e expref: 53 pid: 19955 timeout: 3135 lvb_type: 1 00000100:00100000:3.0:1715205775.351558:0:11771:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a66db440 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:11771:1798520456026688:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.351560:0:11773:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a17704c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:11773:1798520456026624:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.351580:0:11773:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b4b40 going to sleep for 6 seconds 00000100:00100000:0.0:1715205775.351593:0:19222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14669 00000100:00100000:1.0:1715205775.351597:0:32666:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14670 00000100:00100000:0.0:1715205775.351598:0:19222:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6deda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+65:2851:x1798520456026112:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1715205775.351599:0:32666:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ded580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+65:2853:x1798520456025920:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1715205775.351608:0:19222:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:6069 count 1 00010000:00010000:0.0:1715205775.351630:0:19222:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0480/0xb608af43050069ec lrc: 3/0,1 mode: --/PW res: [0x17b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.351639:0:19222:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fb59f80/0xb608af4305006236 lrc: 2/0,0 mode: PR/PR res: [0x17b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230a6 expref: 53 pid: 19955 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1715205775.351645:0:19222:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205775.351646:0:19222:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205775.351647:0:19222:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0480/0xb608af43050069ec lrc: 4/0,1 mode: --/PW res: [0x17b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.351661:0:19222:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fb59f80/0xb608af4305006236 lrc: 3/0,0 mode: PR/PR res: [0x17b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230a6 expref: 53 pid: 19955 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1715205775.351667:0:19222:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fb59f80/0xb608af4305006236 lrc: 4/0,0 mode: PR/PR res: [0x17b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230a6 expref: 53 pid: 19955 timeout: 3135 lvb_type: 1 00000100:00100000:0.0:1715205775.351673:0:19222:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6dea140 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:19222:1798520456026816:192.168.204.8@tcp:104: 00002000:00080000:1.0:1715205775.351707:0:32666:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:6065 count 1 00010000:00010000:1.0:1715205775.351715:0:32666:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b59d680/0xb608af43050069f3 lrc: 3/0,1 mode: --/PW res: [0x17b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.351723:0:32666:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a73aed00/0xb608af43050056f2 lrc: 2/0,0 mode: PW/PW res: [0x17b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22ccb expref: 53 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.351727:0:32666:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1715205775.351728:0:32666:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1715205775.351729:0:32666:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b59d680/0xb608af43050069f3 lrc: 4/0,1 mode: --/PW res: [0x17b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.351734:0:11771:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b9d1180 going to sleep for 6 seconds 00010000:00010000:1.0:1715205775.351741:0:32666:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a73aed00/0xb608af43050056f2 lrc: 3/0,0 mode: PW/PW res: [0x17b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22ccb expref: 53 pid: 19955 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.351746:0:8299:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14671 00010000:00010000:1.0:1715205775.351747:0:32666:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a73aed00/0xb608af43050056f2 lrc: 4/0,0 mode: PW/PW res: [0x17b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22ccb expref: 53 pid: 19955 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.351749:0:8299:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ded0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+65:2853:x1798520456026176:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1715205775.351766:0:32666:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1773440 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:32666:1798520456026880:192.168.204.8@tcp:104: 00002000:00080000:3.0:1715205775.351768:0:8299:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:6066 count 1 00010000:00010000:3.0:1715205775.351776:0:8299:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af43050069fa lrc: 3/0,1 mode: --/PW res: [0x17b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8299 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.351781:0:32666:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b4840 going to sleep for 6 seconds 00010000:00010000:3.0:1715205775.351783:0:8299:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b8c3180/0xb608af430500582d lrc: 2/0,0 mode: PW/PW res: [0x17b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d42 expref: 53 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.351788:0:8299:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1715205775.351789:0:8299:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1715205775.351789:0:8299:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af43050069fa lrc: 4/0,1 mode: --/PW res: [0x17b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8299 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.351791:0:32689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14672 00000100:00100000:1.0:1715205775.351794:0:32689:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66dd0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:2852:x1798520456026368:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1715205775.351801:0:8299:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b8c3180/0xb608af430500582d lrc: 3/0,0 mode: PW/PW res: [0x17b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000000030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d42 expref: 53 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.351807:0:8299:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b8c3180/0xb608af430500582d lrc: 4/0,0 mode: PW/PW res: [0x17b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x70000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d42 expref: 53 pid: 19955 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.351813:0:8299:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a66dcc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8299:1798520456026944:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205775.351828:0:8299:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b9d16c0 going to sleep for 6 seconds 00002000:00080000:1.0:1715205775.351921:0:32689:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:5584 count 1 00010000:00010000:1.0:1715205775.351931:0:32689:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b59c6c0/0xb608af4305006a01 lrc: 3/0,1 mode: --/PW res: [0x15d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.351939:0:32689:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a73ad440/0xb608af430500502a lrc: 2/0,0 mode: PW/PW res: [0x15d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22abe expref: 55 pid: 32689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.351944:0:32689:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1715205775.351945:0:32689:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1715205775.351945:0:32689:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b59c6c0/0xb608af4305006a01 lrc: 4/0,1 mode: --/PW res: [0x15d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.351959:0:32689:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a73ad440/0xb608af430500502a lrc: 3/0,0 mode: PW/PW res: [0x15d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22abe expref: 55 pid: 32689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.351965:0:32689:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a73ad440/0xb608af430500502a lrc: 4/0,0 mode: PW/PW res: [0x15d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22abe expref: 55 pid: 32689 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.351972:0:32689:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009edb0980 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:32689:1798520456027008:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205775.351989:0:19222:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b547240 going to sleep for 6 seconds 00000100:00100000:1.0:1715205775.351990:0:32689:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b46c0 going to sleep for 6 seconds 00000100:00100000:1.0:1715205775.352027:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.352100:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715205775.352108:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6dee3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2854:1798520456026240:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715205775.352122:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d442ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2853:1798520456026432:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1715205775.352123:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715205775.352133:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d444280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2854:1798520456026496:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1715205775.352142:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715205775.352151:0:11776:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456026240 00000100:00100000:1.0:1715205775.352161:0:11776:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456026432 00000100:00100000:0.0:1715205775.352166:0:32645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14676 00000100:00100000:0.0:1715205775.352169:0:32645:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb4740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+66:2854:x1798520456026240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1715205775.352181:0:32645:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:6068 count 1 00010000:00010000:0.0:1715205775.352189:0:32645:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006a16 lrc: 3/0,1 mode: --/PW res: [0x17b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.352198:0:32645:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a73af3c0/0xb608af4305005e3f lrc: 2/0,0 mode: PW/PW res: [0x17b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f56 expref: 54 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.352202:0:32645:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1715205775.352203:0:32645:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1715205775.352204:0:32645:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006a16 lrc: 4/0,1 mode: --/PW res: [0x17b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.352215:0:32645:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a73af3c0/0xb608af4305005e3f lrc: 3/0,0 mode: PW/PW res: [0x17b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x50000000030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f56 expref: 54 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.352222:0:32645:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a73af3c0/0xb608af4305005e3f lrc: 4/0,0 mode: PW/PW res: [0x17b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x70000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f56 expref: 54 pid: 19955 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.352229:0:32645:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6def6c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32645:1798520456027200:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205775.352246:0:32645:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b5476c0 going to sleep for 6 seconds 00000100:00100000:1.0:1715205775.353157:0:11776:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14677 00000100:00100000:1.0:1715205775.353162:0:11776:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6def200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+8:2853:x1798520456026432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1715205775.353173:0:11776:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:5586 count 1 00010000:00010000:1.0:1715205775.353182:0:11776:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b59e640/0xb608af4305006a1d lrc: 3/0,1 mode: --/PW res: [0x15d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.353191:0:11776:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d21f80/0xb608af430500575b lrc: 2/0,0 mode: PR/PR res: [0x15d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22cf5 expref: 55 pid: 19955 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1715205775.353197:0:11776:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205775.353198:0:11776:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205775.353199:0:11776:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b59e640/0xb608af4305006a1d lrc: 4/0,1 mode: --/PW res: [0x15d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.353213:0:11776:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d21f80/0xb608af430500575b lrc: 3/0,0 mode: PR/PR res: [0x15d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22cf5 expref: 55 pid: 19955 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1715205775.353219:0:11776:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d21f80/0xb608af430500575b lrc: 4/0,0 mode: PR/PR res: [0x15d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22cf5 expref: 55 pid: 19955 timeout: 3135 lvb_type: 1 00000100:00100000:1.0:1715205775.353227:0:11776:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009edb2140 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:11776:1798520456027264:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.353355:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715205775.353378:0:8300:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456026496 00000100:00100000:1.0:1715205775.353389:0:8300:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14678 00000100:00100000:1.0:1715205775.353392:0:8300:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:2854:x1798520456026496:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1715205775.353401:0:8300:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:5588 count 1 00010000:00010000:1.0:1715205775.353409:0:8300:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b59f180/0xb608af4305006a24 lrc: 3/0,1 mode: --/PW res: [0x15d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.353422:0:8300:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a7595680/0xb608af4305005d6d lrc: 2/0,0 mode: PR/PR res: [0x15d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f09 expref: 55 pid: 19955 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1715205775.353427:0:8300:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205775.353428:0:8300:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205775.353429:0:8300:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b59f180/0xb608af4305006a24 lrc: 4/0,1 mode: --/PW res: [0x15d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.353603:0:8300:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a7595680/0xb608af4305005d6d lrc: 3/0,0 mode: PR/PR res: [0x15d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f09 expref: 55 pid: 19955 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1715205775.353610:0:8300:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a7595680/0xb608af4305005d6d lrc: 4/0,0 mode: PR/PR res: [0x15d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f09 expref: 55 pid: 19955 timeout: 3135 lvb_type: 1 00000100:00100000:1.0:1715205775.353631:0:8300:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009a480e40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8300:1798520456027328:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.353659:0:8300:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b4240 going to sleep for 6 seconds 00000100:00100000:1.0:1715205775.353683:0:32666:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1773440 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:32666:1798520456026880:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205775.353694:0:32666:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012b59d680/0xb608af43050069f3 lrc: 3/0,1 mode: --/PW res: [0x17b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.353703:0:11771:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a66db440 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:11771:1798520456026688:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.353704:0:11773:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a17704c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:11773:1798520456026624:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205775.353710:0:11773:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012b59f3c0/0xb608af43050069de lrc: 3/0,1 mode: --/PW res: [0x17b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.353714:0:11771:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a73acd80/0xb608af43050069d7 lrc: 3/0,1 mode: --/PW res: [0x17b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11771 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.353716:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.353732:0:11776:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b4f00 going to sleep for 6 seconds 00000100:00100000:3.0:1715205775.353732:0:8299:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a66dcc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8299:1798520456026944:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205775.353736:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1715205775.353739:0:8299:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af43050069fa lrc: 3/0,1 mode: --/PW res: [0x17b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8299 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.353749:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455741760 00000100:00100000:3.0:1715205775.353769:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455741888 00010000:00010000:0.0:1715205775.353774:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099173a80/0xb608af4305005d04 lrc: 4/0,0 mode: PW/PW res: [0x17b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22edf expref: 56 pid: 19955 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.353781:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a73aed00/0xb608af43050056f2 lrc: 4/0,0 mode: PW/PW res: [0x17b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22ccb expref: 56 pid: 19955 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.353793:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4640 00000100:00100000:0.0:1715205775.353797:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6dee880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+56:1830:x1798520455741760:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00000100:00100000:3.0:1715205775.353797:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4641 00000100:00100000:1.0:1715205775.353800:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.353801:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6deed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+56:1830:x1798520455741888:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205775.353804:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.353807:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099173a80/0xb608af4305005d04 lrc: 4/0,0 mode: PW/PW res: [0x17b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22edf expref: 56 pid: 19955 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.353807:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.353809:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a73aed00/0xb608af43050056f2 lrc: 4/0,0 mode: PW/PW res: [0x17b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22ccb expref: 56 pid: 19955 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.353814:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099173a80/0xb608af4305005d04 lrc: 3/0,0 mode: PW/PW res: [0x17b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22edf expref: 56 pid: 19955 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.353816:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a73aed00/0xb608af43050056f2 lrc: 3/0,0 mode: PW/PW res: [0x17b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22ccb expref: 56 pid: 19955 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.353829:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099173a80/0xb608af4305005d04 lrc: 0/0,0 mode: --/PW res: [0x17b3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22edf expref: 56 pid: 19955 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.353829:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a73aed00/0xb608af43050056f2 lrc: 0/0,0 mode: --/PW res: [0x17b1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22ccb expref: 56 pid: 19955 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.353835:0:6662:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205775.353836:0:6662:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205775.353837:0:19709:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205775.353838:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b59f3c0/0xb608af43050069de lrc: 3/0,1 mode: PW/PW res: [0x17b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.353838:0:19709:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205775.353839:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b59d680/0xb608af43050069f3 lrc: 3/0,1 mode: PW/PW res: [0x17b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.353842:0:6662:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b59f3c0/0xb608af43050069de lrc: 4/0,1 mode: PW/PW res: [0x17b3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.353842:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1715205775.353844:0:19709:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b59d680/0xb608af43050069f3 lrc: 4/0,1 mode: PW/PW res: [0x17b1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.353850:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205775.353853:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1715205775.353856:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.353873:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6deed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+54:1830:x1798520455741888:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 72us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.353878:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.353880:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4641 00000100:00100000:0.0:1715205775.353887:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6dee880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+53:1830:x1798520455741760:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 90us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.353890:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455741824 00000100:00100000:1.0:1715205775.353903:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1715205775.353910:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1200/0xb608af430500536b lrc: 4/0,0 mode: PR/PR res: [0x17b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22b9e expref: 54 pid: 19955 timeout: 3135 lvb_type: 1 00000100:00100000:3.0:1715205775.353920:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455742016 00010000:00010000:3.0:1715205775.353926:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8c3600/0xb608af4305006649 lrc: 5/0,0 mode: PW/PW res: [0x17b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2320b expref: 55 pid: 19955 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.353932:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455742144 00010000:00010000:3.0:1715205775.353937:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a73ad440/0xb608af430500502a lrc: 5/0,0 mode: PW/PW res: [0x15d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22abe expref: 56 pid: 32689 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.353945:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455742080 00010000:00010000:3.0:1715205775.353951:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fb59f80/0xb608af4305006236 lrc: 5/0,0 mode: PR/PR res: [0x17b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230a6 expref: 56 pid: 19955 timeout: 3135 lvb_type: 1 00000100:00100000:3.0:1715205775.353958:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455741952 00010000:00010000:3.0:1715205775.353962:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8c3180/0xb608af430500582d lrc: 4/0,0 mode: PW/PW res: [0x17b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d42 expref: 57 pid: 19955 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.353970:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4642 00000100:00100000:3.0:1715205775.353973:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a482f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+57:1831:x1798520455741824:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205775.353978:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1715205775.353981:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1715205775.353981:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1200/0xb608af430500536b lrc: 4/0,0 mode: PR/PR res: [0x17b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22b9e expref: 57 pid: 19955 timeout: 3135 lvb_type: 1 00010000:00010000:3.0:1715205775.353987:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1200/0xb608af430500536b lrc: 3/0,0 mode: PR/PR res: [0x17b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22b9e expref: 57 pid: 19955 timeout: 3135 lvb_type: 1 00000100:00100000:1.0:1715205775.353995:0:9733:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455742208 00010000:00010000:3.0:1715205775.354001:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1200/0xb608af430500536b lrc: 0/0,0 mode: --/PR res: [0x17b0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22b9e expref: 57 pid: 19955 timeout: 3135 lvb_type: 1 00010000:00010000:1.0:1715205775.354005:0:9733:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8c06c0/0xb608af43050065cb lrc: 5/0,0 mode: PW/PW res: [0x15d6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231d3 expref: 57 pid: 19955 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.354008:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4640 00010000:00010000:3.0:1715205775.354009:0:19709:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205775.354010:0:19709:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205775.354011:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a73acd80/0xb608af43050069d7 lrc: 3/0,1 mode: PW/PW res: [0x17b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11771 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.354015:0:9733:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4643 00010000:00010000:3.0:1715205775.354016:0:19709:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a73acd80/0xb608af43050069d7 lrc: 4/0,1 mode: PW/PW res: [0x17b0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11771 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.354017:0:9733:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a17704c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+55:1830:x1798520455742016:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1715205775.354020:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4644 00010000:00010000:1.0:1715205775.354021:0:9733:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.354023:0:9733:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b8c3600/0xb608af4305006649 lrc: 5/0,0 mode: PW/PW res: [0x17b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2320b expref: 55 pid: 19955 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.354024:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1773440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+57:1830:x1798520455742144:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1715205775.354028:0:9733:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b8c3600/0xb608af4305006649 lrc: 4/0,0 mode: PW/PW res: [0x17b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2320b expref: 55 pid: 19955 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.354028:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205775.354030:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.354033:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a73ad440/0xb608af430500502a lrc: 5/0,0 mode: PW/PW res: [0x15d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22abe expref: 57 pid: 32689 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.354035:0:9733:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205775.354036:0:9733:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205775.354037:0:9733:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800940c9200/0xb608af43050069e5 lrc: 3/0,1 mode: PW/PW res: [0x17b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354041:0:9733:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800940c9200/0xb608af43050069e5 lrc: 4/0,1 mode: PW/PW res: [0x17b6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.354043:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a482f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+55:1831:x1798520455741824:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 69us (243us total) trans 0 rc 0/0 00010000:00010000:0.0:1715205775.354044:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a73ad440/0xb608af430500502a lrc: 4/0,0 mode: PW/PW res: [0x15d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22abe expref: 57 pid: 32689 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.354046:0:9733:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.354049:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4642 00000100:00100000:1.0:1715205775.354056:0:9733:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a17704c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+54:1830:x1798520455742016:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 38us (214us total) trans 0 rc 0/0 00010000:00010000:0.0:1715205775.354057:0:6662:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205775.354058:0:6662:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1715205775.354059:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4645 00010000:00010000:0.0:1715205775.354060:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b59c6c0/0xb608af4305006a01 lrc: 3/0,1 mode: PW/PW res: [0x15d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 32689 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.354061:0:9733:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4643 00000100:00100000:3.0:1715205775.354061:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372fa140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+54:1830:x1798520455742080:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205775.354064:0:6662:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b59c6c0/0xb608af4305006a01 lrc: 4/0,1 mode: PW/PW res: [0x15d0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 32689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.354066:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1715205775.354067:0:9733:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4646 00000100:00100000:1.0:1715205775.354069:0:9733:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b2c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+53:1831:x1798520455741952:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205775.354069:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fb59f80/0xb608af4305006236 lrc: 5/0,0 mode: PR/PR res: [0x17b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230a6 expref: 53 pid: 19955 timeout: 3135 lvb_type: 1 00010000:00010000:0.0:1715205775.354073:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205775.354073:0:9733:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.354075:0:9733:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b8c3180/0xb608af430500582d lrc: 4/0,0 mode: PW/PW res: [0x17b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d42 expref: 53 pid: 19955 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.354076:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fb59f80/0xb608af4305006236 lrc: 4/0,0 mode: PR/PR res: [0x17b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230a6 expref: 53 pid: 19955 timeout: 3135 lvb_type: 1 00010000:00010000:1.0:1715205775.354079:0:9733:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b8c3180/0xb608af430500582d lrc: 3/0,0 mode: PW/PW res: [0x17b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d42 expref: 53 pid: 19955 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.354085:0:9733:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b8c3180/0xb608af430500582d lrc: 0/0,0 mode: --/PW res: [0x17b2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x44801400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22d42 expref: 53 pid: 19955 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.354085:0:19709:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205775.354086:0:19709:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1715205775.354087:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1773440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+57:1830:x1798520455742144:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 63us (233us total) trans 0 rc 0/0 00010000:00010000:3.0:1715205775.354088:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0480/0xb608af43050069ec lrc: 3/0,1 mode: PW/PW res: [0x17b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354089:0:9733:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205775.354090:0:9733:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205775.354091:0:9733:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af43050069fa lrc: 3/0,1 mode: PW/PW res: [0x17b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8299 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.354092:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4644 00010000:00010000:3.0:1715205775.354092:0:19709:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0480/0xb608af43050069ec lrc: 4/0,1 mode: PW/PW res: [0x17b5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354094:0:9733:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af43050069fa lrc: 4/0,1 mode: PW/PW res: [0x17b2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8299 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354100:0:9733:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205775.354101:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205775.354102:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4647 00000100:00100000:0.0:1715205775.354105:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372ff200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+56:1830:x1798520455742208:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1715205775.354107:0:9733:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b2c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+52:1831:x1798520455741952:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 37us (205us total) trans 0 rc 0/0 00010000:00010000:0.0:1715205775.354110:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1715205775.354110:0:9733:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4646 00010000:00010000:0.0:1715205775.354113:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b8c06c0/0xb608af43050065cb lrc: 5/0,0 mode: PW/PW res: [0x15d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231d3 expref: 56 pid: 19955 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.354113:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372fa140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+51:1830:x1798520455742080:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 51us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.354118:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4645 00010000:00010000:0.0:1715205775.354120:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b8c06c0/0xb608af43050065cb lrc: 4/0,0 mode: PW/PW res: [0x15d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b231d3 expref: 56 pid: 19955 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.354127:0:32689:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a73ad440/0xb608af430500502a lrc: 0/0,0 mode: --/PW res: [0x15d0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22abe expref: 56 pid: 32689 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.354129:0:6662:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205775.354130:0:6662:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205775.354132:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800940c9b00/0xb608af4305006a08 lrc: 3/0,1 mode: PW/PW res: [0x15d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 2451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.354135:0:32689:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009edb0980 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:32689:1798520456027008:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205775.354137:0:6662:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800940c9b00/0xb608af4305006a08 lrc: 4/0,1 mode: PW/PW res: [0x15d6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 2451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354141:0:32689:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012b59c6c0/0xb608af4305006a01 lrc: 3/0,1 mode: PW/PW res: [0x15d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354144:0:32689:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012b59c6c0/0xb608af4305006a01 lrc: 3/0,1 mode: PW/PW res: [0x15d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32689 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.354145:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205775.354147:0:32689:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b59c6c0/0xb608af4305006a01 lrc: 3/0,1 mode: PW/PW res: [0x15d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.354148:0:8299:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af43050069fa lrc: 3/0,1 mode: PW/PW res: [0x17b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8299 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354151:0:32689:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b59c6c0/0xb608af4305006a01 lrc: 3/0,1 mode: PW/PW res: [0x15d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354154:0:32689:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b59c6c0/0xb608af4305006a01 lrc: 2/0,0 mode: PW/PW res: [0x15d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.354154:0:8299:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af43050069fa lrc: 3/0,1 mode: PW/PW res: [0x17b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8299 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.354157:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372ff200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+55:1830:x1798520455742208:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 51us (176us total) trans 0 rc 0/0 00010000:00010000:3.0:1715205775.354159:0:8299:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af43050069fa lrc: 3/0,1 mode: PW/PW res: [0x17b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8299 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.354161:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4647 00010000:00010000:1.0:1715205775.354161:0:32689:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1715205775.354163:0:8299:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af43050069fa lrc: 2/0,0 mode: PW/PW res: [0x17b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8299 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.354173:0:8299:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1715205775.354184:0:19222:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fb59f80/0xb608af4305006236 lrc: 0/0,0 mode: --/PR res: [0x17b5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230a6 expref: 50 pid: 19955 timeout: 3135 lvb_type: 1 00000100:00100000:0.0:1715205775.354192:0:19222:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6dea140 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:19222:1798520456026816:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205775.354200:0:19222:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0480/0xb608af43050069ec lrc: 3/0,1 mode: PW/PW res: [0x17b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.354205:0:19222:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0480/0xb608af43050069ec lrc: 3/0,1 mode: PW/PW res: [0x17b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.354209:0:19222:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0480/0xb608af43050069ec lrc: 3/0,1 mode: PW/PW res: [0x17b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.354214:0:19222:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0480/0xb608af43050069ec lrc: 3/0,1 mode: PW/PW res: [0x17b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.354218:0:19222:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0480/0xb608af43050069ec lrc: 2/0,0 mode: PW/PW res: [0x17b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19222 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.354231:0:19222:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1715205775.354304:0:32689:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66dd0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+10:2852:x1798520456026368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2510us (3133us total) trans 4294970694 rc 0/0 00000100:00100000:1.0:1715205775.354309:0:32689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14672 00010000:00010000:1.0:1715205775.354322:0:8314:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1715205775.354325:0:8314:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b59c6c0/0xb608af4305006a01 lrc: 2/0,0 mode: PW/PW res: [0x15d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354331:0:8314:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59c6c0 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:1.0:1715205775.354333:0:8314:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b59c6c0/0xb608af4305006a01 lrc: 2/0,0 mode: PW/PW res: [0x15d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32689 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354339:0:8314:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b59c6c0/0xb608af4305006a01 lrc: 3/0,0 mode: PW/PW res: [0x15d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.354346:0:6665:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1715205775.354349:0:8314:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b59c6c0/0xb608af4305006a01 lrc: 1/0,0 mode: --/PW res: [0x15d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.354349:0:6665:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af43050069fa lrc: 2/0,0 mode: PW/PW res: [0x17b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8299 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354353:0:8314:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b59c6c0/0xb608af4305006a01 lrc: 0/0,0 mode: --/PW res: [0x15d0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32689 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.354355:0:6665:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73adf80 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:3.0:1715205775.354356:0:6665:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af43050069fa lrc: 2/0,0 mode: PW/PW res: [0x17b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8299 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.354362:0:6665:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af43050069fa lrc: 3/0,0 mode: PW/PW res: [0x17b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8299 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354363:0:8314:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715205775.354365:0:8314:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0480/0xb608af43050069ec lrc: 2/0,0 mode: PW/PW res: [0x17b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354369:0:8314:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c0480 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:1.0:1715205775.354370:0:8314:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0480/0xb608af43050069ec lrc: 2/0,0 mode: PW/PW res: [0x17b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.354371:0:6665:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af43050069fa lrc: 1/0,0 mode: --/PW res: [0x17b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8299 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354374:0:8314:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0480/0xb608af43050069ec lrc: 3/0,0 mode: PW/PW res: [0x17b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19222 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.354376:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af43050069fa lrc: 0/0,0 mode: --/PW res: [0x17b2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8299 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.354380:0:6569:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205775.354381:0:8314:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0480/0xb608af43050069ec lrc: 1/0,0 mode: --/PW res: [0x17b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354385:0:8314:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0480/0xb608af43050069ec lrc: 0/0,0 mode: --/PW res: [0x17b5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19222 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354395:0:8314:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205775.354396:0:8314:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205775.354398:0:8314:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205775.354403:0:32666:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012b59d680/0xb608af43050069f3 lrc: 3/0,1 mode: PW/PW res: [0x17b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.354403:0:6665:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715205775.354405:0:6665:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715205775.354406:0:6665:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205775.354408:0:32666:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b59d680/0xb608af43050069f3 lrc: 3/0,1 mode: PW/PW res: [0x17b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354413:0:32666:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b59d680/0xb608af43050069f3 lrc: 3/0,1 mode: PW/PW res: [0x17b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354417:0:32666:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b59d680/0xb608af43050069f3 lrc: 2/0,0 mode: PW/PW res: [0x17b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354426:0:32666:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1715205775.354427:0:2852:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff88012d4450c0/2, rc 0, transno 3398 00000100:00100000:3.0:1715205775.354431:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d4450c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2852:1798520456026368:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1715205775.354440:0:11771:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a73acd80/0xb608af43050069d7 lrc: 3/0,1 mode: PW/PW res: [0x17b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11771 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.354445:0:11771:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a73acd80/0xb608af43050069d7 lrc: 3/0,1 mode: PW/PW res: [0x17b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11771 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.354450:0:11771:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a73acd80/0xb608af43050069d7 lrc: 3/0,1 mode: PW/PW res: [0x17b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11771 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.354454:0:11771:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a73acd80/0xb608af43050069d7 lrc: 2/0,0 mode: PW/PW res: [0x17b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11771 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.354463:0:11771:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1715205775.354464:0:11161:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1715205775.354467:0:11161:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b59d680/0xb608af43050069f3 lrc: 2/0,0 mode: PW/PW res: [0x17b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354471:0:11161:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59d680 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:1.0:1715205775.354472:0:11161:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b59d680/0xb608af43050069f3 lrc: 2/0,0 mode: PW/PW res: [0x17b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354477:0:11161:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b59d680/0xb608af43050069f3 lrc: 3/0,0 mode: PW/PW res: [0x17b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354484:0:11161:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b59d680/0xb608af43050069f3 lrc: 1/0,0 mode: --/PW res: [0x17b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354493:0:11161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b59d680/0xb608af43050069f3 lrc: 0/0,0 mode: --/PW res: [0x17b1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354502:0:11161:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715205775.354503:0:11161:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a73acd80/0xb608af43050069d7 lrc: 2/0,0 mode: PW/PW res: [0x17b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11771 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354507:0:11161:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73acd80 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:1.0:1715205775.354508:0:11161:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a73acd80/0xb608af43050069d7 lrc: 2/0,0 mode: PW/PW res: [0x17b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11771 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354512:0:11161:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a73acd80/0xb608af43050069d7 lrc: 3/0,0 mode: PW/PW res: [0x17b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11771 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.354513:0:8299:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ded0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+68:2853:x1798520456026176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2763us (3596us total) trans 30064771472 rc 0/0 00010000:00010000:1.0:1715205775.354516:0:11161:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a73acd80/0xb608af43050069d7 lrc: 1/0,0 mode: --/PW res: [0x17b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11771 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.354519:0:8299:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14671 00010000:00010000:1.0:1715205775.354520:0:11161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a73acd80/0xb608af43050069d7 lrc: 0/0,0 mode: --/PW res: [0x17b0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11771 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354530:0:11161:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205775.354530:0:11161:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205775.354532:0:6664:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205775.354532:0:11161:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205775.354535:0:11773:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012b59f3c0/0xb608af43050069de lrc: 3/0,1 mode: PW/PW res: [0x17b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354539:0:11773:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b59f3c0/0xb608af43050069de lrc: 3/0,1 mode: PW/PW res: [0x17b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354544:0:11773:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b59f3c0/0xb608af43050069de lrc: 3/0,1 mode: PW/PW res: [0x17b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715205775.354546:0:2853:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff8800a6dedf00/2, rc 0, transno 400 00000100:00100000:0.0:1715205775.354549:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6dedf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2853:1798520456026176:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1715205775.354549:0:11773:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b59f3c0/0xb608af43050069de lrc: 2/0,0 mode: PW/PW res: [0x17b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354557:0:11773:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1715205775.354588:0:6569:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715205775.354590:0:6569:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b59f3c0/0xb608af43050069de lrc: 2/0,0 mode: PW/PW res: [0x17b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354595:0:6569:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59f3c0 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:1.0:1715205775.354597:0:6569:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b59f3c0/0xb608af43050069de lrc: 2/0,0 mode: PW/PW res: [0x17b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354602:0:6569:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b59f3c0/0xb608af43050069de lrc: 3/0,0 mode: PW/PW res: [0x17b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.354605:0:19222:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6deda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+67:2851:x1798520456026112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3006us (3737us total) trans 30064771473 rc 0/0 00010000:00010000:1.0:1715205775.354609:0:6569:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b59f3c0/0xb608af43050069de lrc: 1/0,0 mode: --/PW res: [0x17b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.354611:0:19222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14669 00010000:00010000:1.0:1715205775.354613:0:6569:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b59f3c0/0xb608af43050069de lrc: 0/0,0 mode: --/PW res: [0x17b3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354641:0:6569:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205775.354642:0:6569:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205775.354643:0:6569:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205775.354658:0:19955:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b8c3600/0xb608af4305006649 lrc: 0/0,0 mode: --/PW res: [0x17b6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2320b expref: 49 pid: 19955 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.354666:0:19955:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009ce78000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19955:1798520456026752:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205775.354676:0:19955:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800940c9200/0xb608af43050069e5 lrc: 3/0,1 mode: PW/PW res: [0x17b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354681:0:19955:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800940c9200/0xb608af43050069e5 lrc: 3/0,1 mode: PW/PW res: [0x17b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354685:0:19955:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800940c9200/0xb608af43050069e5 lrc: 3/0,1 mode: PW/PW res: [0x17b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.354685:0:11771:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66ded40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+67:2852:x1798520456025856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3211us (4143us total) trans 30064771474 rc 0/0 00010000:00010000:1.0:1715205775.354690:0:19955:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800940c9200/0xb608af43050069e5 lrc: 3/0,1 mode: PW/PW res: [0x17b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.354692:0:11771:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14666 00010000:00010000:1.0:1715205775.354694:0:19955:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800940c9200/0xb608af43050069e5 lrc: 2/0,0 mode: PW/PW res: [0x17b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715205775.354734:0:2852:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff8800a6de8000/2, rc 0, transno 402 00000100:00100000:3.0:1715205775.354737:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2852:1798520456025856:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1715205775.354762:0:19955:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1715205775.354792:0:6665:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1715205775.354795:0:6665:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800940c9200/0xb608af43050069e5 lrc: 2/0,0 mode: PW/PW res: [0x17b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.354800:0:6665:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940c9200 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:3.0:1715205775.354802:0:6665:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800940c9200/0xb608af43050069e5 lrc: 2/0,0 mode: PW/PW res: [0x17b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.354807:0:6665:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800940c9200/0xb608af43050069e5 lrc: 3/0,0 mode: PW/PW res: [0x17b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.354816:0:6665:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800940c9200/0xb608af43050069e5 lrc: 1/0,0 mode: --/PW res: [0x17b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.354820:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800940c9200/0xb608af43050069e5 lrc: 0/0,0 mode: --/PW res: [0x17b6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.354829:0:6665:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715205775.354831:0:6665:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800940c9b00/0xb608af4305006a08 lrc: 2/0,0 mode: PW/PW res: [0x15d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 2451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.354835:0:6665:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940c9b00 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:3.0:1715205775.354837:0:6665:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800940c9b00/0xb608af4305006a08 lrc: 2/0,0 mode: PW/PW res: [0x15d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 2451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.354842:0:6665:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800940c9b00/0xb608af4305006a08 lrc: 3/0,0 mode: PW/PW res: [0x15d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 2451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.354848:0:6665:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800940c9b00/0xb608af4305006a08 lrc: 1/0,0 mode: --/PW res: [0x15d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 2451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.354849:0:8314:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715205775.354853:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800940c9b00/0xb608af4305006a08 lrc: 0/0,0 mode: --/PW res: [0x15d6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 2451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.354863:0:6665:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1715205775.354864:0:2851:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff8800a6de9300/2, rc 0, transno 401 00010000:00010000:3.0:1715205775.354864:0:6665:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715205775.354865:0:6665:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715205775.354868:0:2851:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6de9300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2851:1798520456026112:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1715205775.355372:0:8300:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009a480e40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8300:1798520456027328:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205775.355386:0:8300:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012b59f180/0xb608af4305006a24 lrc: 3/0,1 mode: --/PW res: [0x15d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.355486:0:11776:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009edb2140 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:11776:1798520456027264:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205775.355495:0:11776:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012b59e640/0xb608af4305006a1d lrc: 3/0,1 mode: --/PW res: [0x15d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11776 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.355538:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.355651:0:19955:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6de97c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+67:2851:x1798520456026304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4058us (4813us total) trans 30064771475 rc 0/0 00000100:00100000:1.0:1715205775.355656:0:19955:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14668 00000100:00100000:0.0:1715205775.355697:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.355724:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.355825:0:32645:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6def6c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32645:1798520456027200:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205775.355835:0:32645:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006a16 lrc: 3/0,1 mode: --/PW res: [0x17b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.355865:0:7373:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455742400 00010000:00010000:3.0:1715205775.355876:0:7373:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d21f80/0xb608af430500575b lrc: 4/0,0 mode: PR/PR res: [0x15d2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22cf5 expref: 54 pid: 19955 timeout: 3135 lvb_type: 1 00000100:00100000:3.0:1715205775.355891:0:7373:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455742336 00010000:00010000:3.0:1715205775.355897:0:7373:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a7595680/0xb608af4305005d6d lrc: 4/0,0 mode: PR/PR res: [0x15d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f09 expref: 55 pid: 19955 timeout: 3135 lvb_type: 1 00000100:00100000:0.0:1715205775.355904:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4648 00000100:00100000:0.0:1715205775.355908:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6dea140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+49:1830:x1798520455742272:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205775.355915:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.355919:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a73af3c0/0xb608af4305005e3f lrc: 4/0,0 mode: PW/PW res: [0x17b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f56 expref: 49 pid: 19955 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.355928:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a73af3c0/0xb608af4305005e3f lrc: 3/0,0 mode: PW/PW res: [0x17b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x50000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f56 expref: 49 pid: 19955 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.355939:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a73af3c0/0xb608af4305005e3f lrc: 0/0,0 mode: --/PW res: [0x17b4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x44801400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f56 expref: 49 pid: 19955 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.355946:0:8315:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205775.355948:0:8315:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205775.355949:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006a16 lrc: 3/0,1 mode: PW/PW res: [0x17b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.355953:0:8315:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006a16 lrc: 4/0,1 mode: PW/PW res: [0x17b4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.355965:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205775.355980:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6dea140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+48:1830:x1798520455742272:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 72us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.356065:0:11773:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6de9c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+67:2851:x1798520456026048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4586us (5253us total) trans 30064771476 rc 0/0 00000100:00100000:3.0:1715205775.356088:0:7373:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4650 00000100:00100000:3.0:1715205775.356092:0:7373:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6dee880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+55:1831:x1798520455742336:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1715205775.356099:0:7373:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.356103:0:7373:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a7595680/0xb608af4305005d6d lrc: 4/0,0 mode: PR/PR res: [0x15d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f09 expref: 55 pid: 19955 timeout: 3135 lvb_type: 1 00010000:00010000:3.0:1715205775.356114:0:7373:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a7595680/0xb608af4305005d6d lrc: 3/0,0 mode: PR/PR res: [0x15d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f09 expref: 55 pid: 19955 timeout: 3135 lvb_type: 1 00010000:00010000:3.0:1715205775.356125:0:7373:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a7595680/0xb608af4305005d6d lrc: 0/0,0 mode: --/PR res: [0x15d4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22f09 expref: 54 pid: 19955 timeout: 3135 lvb_type: 1 00010000:00010000:3.0:1715205775.356133:0:7373:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205775.356134:0:7373:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205775.356135:0:7373:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b59f180/0xb608af4305006a24 lrc: 3/0,1 mode: PW/PW res: [0x15d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.356140:0:7373:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b59f180/0xb608af4305006a24 lrc: 4/0,1 mode: PW/PW res: [0x15d4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.356152:0:7373:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205775.356166:0:7373:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6dee880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+52:1831:x1798520455742336:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 74us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.356172:0:7373:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4650 00000100:00100000:1.0:1715205775.356176:0:11773:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14667 00010000:00010000:1.0:1715205775.356191:0:11776:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012b59e640/0xb608af4305006a1d lrc: 3/0,1 mode: PW/PW res: [0x15d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.356197:0:11776:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b59e640/0xb608af4305006a1d lrc: 3/0,1 mode: PW/PW res: [0x15d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.356252:0:11776:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b59e640/0xb608af4305006a1d lrc: 3/0,1 mode: PW/PW res: [0x15d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.356258:0:11776:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b59e640/0xb608af4305006a1d lrc: 2/0,0 mode: PW/PW res: [0x15d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11776 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.356260:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4648 00010000:00010000:1.0:1715205775.356271:0:11776:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1715205775.356356:0:2851:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff8800a6de8e40/2, rc 0, transno 404 00000100:00100000:0.0:1715205775.356360:0:2851:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6de8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2851:1798520456026048:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1715205775.356367:0:2851:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff8800a6de84c0/2, rc 0, transno 403 00000100:00100000:0.0:1715205775.356369:0:2851:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6de84c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2851:1798520456026304:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1715205775.356379:0:32645:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006a16 lrc: 3/0,1 mode: PW/PW res: [0x17b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.356384:0:32645:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006a16 lrc: 3/0,1 mode: PW/PW res: [0x17b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.356390:0:32645:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006a16 lrc: 3/0,1 mode: PW/PW res: [0x17b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.356394:0:32645:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006a16 lrc: 2/0,0 mode: PW/PW res: [0x17b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.356403:0:32645:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1715205775.356451:0:6664:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1715205775.356454:0:6664:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b59e640/0xb608af4305006a1d lrc: 2/0,0 mode: PW/PW res: [0x15d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.356459:0:6664:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59e640 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:1.0:1715205775.356460:0:6664:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b59e640/0xb608af4305006a1d lrc: 2/0,0 mode: PW/PW res: [0x15d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.356469:0:6664:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b59e640/0xb608af4305006a1d lrc: 3/0,0 mode: PW/PW res: [0x15d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.356477:0:6664:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b59e640/0xb608af4305006a1d lrc: 1/0,0 mode: --/PW res: [0x15d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.356481:0:6664:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b59e640/0xb608af4305006a1d lrc: 0/0,0 mode: --/PW res: [0x15d2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11776 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.356490:0:6664:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715205775.356492:0:6664:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006a16 lrc: 2/0,0 mode: PW/PW res: [0x17b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.356501:0:6664:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c0fc0 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:1.0:1715205775.356502:0:6664:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006a16 lrc: 2/0,0 mode: PW/PW res: [0x17b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.356506:0:6664:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006a16 lrc: 3/0,0 mode: PW/PW res: [0x17b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.356513:0:6664:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006a16 lrc: 1/0,0 mode: --/PW res: [0x17b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.356517:0:6664:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006a16 lrc: 0/0,0 mode: --/PW res: [0x17b4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.356526:0:6664:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205775.356528:0:6664:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205775.356529:0:6664:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205775.356534:0:8300:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012b59f180/0xb608af4305006a24 lrc: 3/0,1 mode: PW/PW res: [0x15d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.356539:0:8300:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b59f180/0xb608af4305006a24 lrc: 3/0,1 mode: PW/PW res: [0x15d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.356544:0:8300:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b59f180/0xb608af4305006a24 lrc: 3/0,1 mode: PW/PW res: [0x15d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.356548:0:8300:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b59f180/0xb608af4305006a24 lrc: 2/0,0 mode: PW/PW res: [0x15d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.356556:0:8300:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1715205775.356610:0:32645:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb4740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+67:2854:x1798520456026240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4440us (4486us total) trans 30064771477 rc 0/0 00000100:00100000:0.0:1715205775.356630:0:32645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14676 00010000:00010000:0.0:1715205775.356643:0:11161:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715205775.356646:0:11161:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b59f180/0xb608af4305006a24 lrc: 2/0,0 mode: PW/PW res: [0x15d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.356652:0:11161:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59f180 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:0.0:1715205775.356653:0:11161:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b59f180/0xb608af4305006a24 lrc: 2/0,0 mode: PW/PW res: [0x15d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.356659:0:11161:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b59f180/0xb608af4305006a24 lrc: 3/0,0 mode: PW/PW res: [0x15d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.356667:0:11161:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b59f180/0xb608af4305006a24 lrc: 1/0,0 mode: --/PW res: [0x15d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.356672:0:11161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b59f180/0xb608af4305006a24 lrc: 0/0,0 mode: --/PW res: [0x15d4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.356681:0:8300:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:2854:x1798520456026496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3286us (3325us total) trans 4294970696 rc 0/0 00000100:00100000:1.0:1715205775.356686:0:8300:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14678 00010000:00010000:0.0:1715205775.356687:0:11161:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205775.356688:0:11161:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205775.356689:0:11161:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205775.356700:0:6569:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715205775.356772:0:11776:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6def200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+10:2853:x1798520456026432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3610us (4630us total) trans 4294970697 rc 0/0 00000100:00100000:1.0:1715205775.356777:0:11776:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14677 00000100:00100000:0.0:1715205775.356833:0:32666:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ded580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+67:2853:x1798520456025920:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5232us (5935us total) trans 30064771478 rc 0/0 00000100:00100000:0.0:1715205775.356838:0:32666:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14670 00000004:00080000:0.0:1715205775.356857:0:2853:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff88012d442ac0/2, rc 0, transno 3401 00000100:00100000:0.0:1715205775.356860:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d442ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2853:1798520456026432:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1715205775.356866:0:2853:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff8800a6de8980/2, rc 0, transno 406 00000100:00100000:0.0:1715205775.356868:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6de8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2853:1798520456025920:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1715205775.357873:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.357885:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455742464 00010000:00010000:0.0:1715205775.357897:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a75961c0/0xb608af4305004d4b lrc: 4/0,0 mode: PW/PW res: [0x15cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b229ec expref: 52 pid: 19222 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.357912:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4651 00000100:00100000:0.0:1715205775.357915:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6def6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+52:1830:x1798520455742464:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1715205775.357921:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.357924:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a75961c0/0xb608af4305004d4b lrc: 4/0,0 mode: PW/PW res: [0x15cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b229ec expref: 52 pid: 19222 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.357931:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a75961c0/0xb608af4305004d4b lrc: 3/0,0 mode: PW/PW res: [0x15cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b229ec expref: 52 pid: 19222 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.357942:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a75961c0/0xb608af4305004d4b lrc: 0/0,0 mode: --/PW res: [0x15cf:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b229ec expref: 52 pid: 19222 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.357949:0:6662:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205775.357951:0:6662:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205775.357952:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800940caac0/0xb608af4305006a0f lrc: 3/0,1 mode: PW/PW res: [0x15cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.357958:0:6662:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800940caac0/0xb608af4305006a0f lrc: 4/0,1 mode: PW/PW res: [0x15cf:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.358479:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205775.358497:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6def6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+51:1830:x1798520455742464:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 581us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.358503:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4651 00000001:00080000:1.0:1715205775.383941:0:24534:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0000: transno 30064771469 is committed 00000001:00080000:1.0:1715205775.383957:0:24534:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0000: transno 30064771463 is committed 00000001:00080000:1.0:1715205775.383985:0:24534:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0000: transno 30064771470 is committed 00000001:00080000:1.0:1715205775.384024:0:24534:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0000: transno 30064771464 is committed 00000001:00080000:1.0:1715205775.384060:0:24534:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0000: transno 30064771471 is committed 00000100:00100000:0.0:1715205775.384066:0:19961:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb5580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+38:1830:x1798520455741696:12345-192.168.204.8@tcp:16:dbench.0 Request processed in 32003us (32035us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.384076:0:19961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14674 00000100:00100000:0.0:1715205775.388958:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.389524:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455742528 00000100:00100000:1.0:1715205775.389568:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1727 00000100:00100000:1.0:1715205775.389574:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6dec740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+100:11754:x1798520455742528:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.389588:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.389602:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305006a2b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23362 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.389665:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305006a32 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.389787:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305006a32 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.389797:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305006a32 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.389808:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305006a39 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.389814:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305006a39 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.389819:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305006a39 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.389885:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305006a32 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.389891:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305006a32 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.389895:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305006a32 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.389901:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59f3c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.389903:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305006a32 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.389908:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305006a32 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.389916:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.389919:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.389921:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305006a32 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.389926:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305006a32 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.389934:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305006a39 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.389938:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305006a39 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.389942:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305006a39 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.389946:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59d680 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.389947:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305006a39 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.389952:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305006a39 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.389958:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x60ff3b22 (ffff880129f26400) 00010000:00010000:1.0:1715205775.389959:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.389961:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305006a39 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.389965:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305006a39 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.389996:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305006a2b lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23362 expref: 101 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.390002:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305006a2b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23362 expref: 101 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.390008:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59e640, rc 0) 00010000:00000080:1.0:1715205775.390013:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6dec740 x1798520455742528/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.390059:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6dec740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+100:11754:x1798520455742528:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 485us (1105us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205775.390065:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1727 00000100:00100000:1.0:1715205775.392312:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455742592 00000100:00100000:1.0:1715205775.392340:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1728 00000100:00100000:1.0:1715205775.392345:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+100:11754:x1798520455742592:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.392354:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.392363:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af4305006a40 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23369 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.392385:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af4305006a40 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23369 expref: 101 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.392393:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af4305006a40 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23369 expref: 101 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.392399:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.392401:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.392403:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59c6c0, rc 0) 00010000:00000080:1.0:1715205775.392405:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce7d0c0 x1798520455742592/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 328/344 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.392439:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+101:11754:x1798520455742592:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 93us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.392446:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1728 00000100:00100000:0.0:1715205775.393924:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.393975:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455742656 00000100:00100000:3.0:1715205775.394005:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 454 00000100:00100000:3.0:1715205775.394009:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091815050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+101:11754:x1798520455742656:12345-192.168.204.8@tcp:37:dbench.0 00010000:00000080:3.0:1715205775.396110:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880091815050 x1798520455742656/t0(0) o37->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 448/440 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.396143:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091815050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+101:11754:x1798520455742656:12345-192.168.204.8@tcp:37:dbench.0 Request processed in 2134us (2221us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.396151:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 454 00000100:00100000:1.0:1715205775.397956:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455742784 00000100:00100000:1.0:1715205775.398002:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1729 00000100:00100000:1.0:1715205775.398006:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+101:11754:x1798520455742784:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.398019:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.398033:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59cb40/0xb608af4305006a47 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23370 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.398115:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305006a4e lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.398125:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305006a4e lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.398138:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305006a4e lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.398150:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305006a55 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.398155:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305006a55 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.398233:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305006a55 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.398273:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305006a4e lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.398279:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305006a4e lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.398283:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305006a4e lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.398288:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59fcc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.398291:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305006a4e lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.398296:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305006a4e lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.398303:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.398305:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.398307:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305006a4e lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.398311:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305006a4e lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.398318:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305006a55 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.398321:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305006a55 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.398325:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305006a55 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.398329:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59f180 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.398330:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305006a55 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.398334:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305006a55 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.398339:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x60ff3b22 (ffff880129f26800) 00010000:00010000:1.0:1715205775.398341:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.398343:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305006a55 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.398346:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305006a55 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.398370:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59cb40/0xb608af4305006a47 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23370 expref: 102 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.398376:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59cb40/0xb608af4305006a47 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23370 expref: 102 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.398381:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59cb40, rc 0) 00010000:00000080:1.0:1715205775.398385:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce7f6c0 x1798520455742784/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 656/600 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.398421:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+101:11754:x1798520455742784:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 415us (565us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205775.398427:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1729 00000100:00100000:0.0:1715205775.399708:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.399807:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455742848 00000100:00100000:1.0:1715205775.399847:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1730 00000100:00100000:1.0:1715205775.399853:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6deaac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+101:11754:x1798520455742848:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.399866:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.399879:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305006a5c lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23377 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.399919:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305006a63 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.399929:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305006a63 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.399938:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305006a63 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.399949:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305006a6a lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.399955:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305006a6a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.399960:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305006a6a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.400022:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305006a63 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.400027:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305006a63 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.400031:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305006a63 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.400036:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59dd40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.400038:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305006a63 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.400043:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305006a63 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.400052:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.400054:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.400056:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305006a63 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.400065:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305006a63 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.400074:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305006a6a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.400079:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305006a6a lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.400083:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305006a6a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.400087:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59ed00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.400089:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305006a6a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.400092:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305006a6a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.400097:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x60b23c20 (ffff880129f26b00) 00010000:00010000:1.0:1715205775.400099:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.400100:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305006a6a lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.400104:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305006a6a lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.400134:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305006a5c lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23377 expref: 102 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.400144:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305006a5c lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23377 expref: 102 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.400150:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59eac0, rc 0) 00010000:00000080:1.0:1715205775.400154:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6deaac0 x1798520455742848/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.400201:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6deaac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+101:11754:x1798520455742848:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 348us (496us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205775.400207:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1730 00000100:00100000:0.0:1715205775.401983:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.402064:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455742976 00000100:00100000:1.0:1715205775.402102:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1731 00000100:00100000:1.0:1715205775.402106:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+101:11754:x1798520455742976:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.402118:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.402129:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af4305006a71 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2337e expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.402195:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af4305006a78 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.402204:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af4305006a78 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.402211:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af4305006a78 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.402221:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305006a7f lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.402226:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305006a7f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.402231:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305006a7f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.402261:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af4305006a78 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.402272:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af4305006a78 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.402277:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af4305006a78 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.402281:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59c240 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.402284:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af4305006a78 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.402289:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af4305006a78 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.402296:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.402297:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.402300:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af4305006a78 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.402304:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af4305006a78 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.402316:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305006a7f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.402321:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305006a7f lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.402325:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305006a7f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.402330:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59db00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.402331:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305006a7f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.402335:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305006a7f lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.402341:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x60b23c20 (ffff880129f26e00) 00010000:00010000:1.0:1715205775.402343:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.402344:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305006a7f lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.402348:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305006a7f lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.402369:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af4305006a71 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2337e expref: 102 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.402375:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af4305006a71 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2337e expref: 102 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.402382:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59f600, rc 0) 00010000:00000080:1.0:1715205775.402386:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910eda40 x1798520455742976/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 656/600 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.402426:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+101:11754:x1798520455742976:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 318us (446us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205775.402432:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1731 00000100:00100000:1.0:1715205775.404648:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455743040 00000100:00100000:1.0:1715205775.404691:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1732 00000100:00100000:1.0:1715205775.404695:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+101:11754:x1798520455743040:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.404710:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.404724:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305006a86 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23385 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.404777:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305006a8d lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.404787:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305006a8d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.404795:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305006a8d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.404805:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305006a94 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.404810:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305006a94 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.404819:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305006a94 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.404872:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305006a8d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.404878:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305006a8d lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.404883:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305006a8d lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.404888:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59d200 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.404890:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305006a8d lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.404895:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305006a8d lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.404903:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.404905:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.404907:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305006a8d lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.404912:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305006a8d lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.404920:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305006a94 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.404929:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305006a94 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.404933:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305006a94 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.404938:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59c000 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.404939:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305006a94 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.404943:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305006a94 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.404949:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x60ff3b22 (ffff880129f26100) 00010000:00010000:1.0:1715205775.404951:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.404952:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305006a94 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.404956:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305006a94 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.404988:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305006a86 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23385 expref: 102 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.404994:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305006a86 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23385 expref: 102 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.405000:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59e1c0, rc 0) 00010000:00000080:1.0:1715205775.405004:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce78000 x1798520455743040/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.405048:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+101:11754:x1798520455743040:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 351us (487us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205775.405054:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1732 00000100:00100000:0.0:1715205775.407042:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.407100:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455743168 00000100:00100000:1.0:1715205775.407142:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1733 00000100:00100000:1.0:1715205775.407146:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910e84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+101:11754:x1798520455743168:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.407158:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.407170:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305006a9b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2338c expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.407243:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305006aa2 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.407254:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305006aa2 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.407261:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305006aa2 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.407270:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305006aa9 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.407276:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305006aa9 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.407281:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305006aa9 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.407329:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305006aa2 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.407335:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305006aa2 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.407340:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305006aa2 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.407344:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59d680 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.407347:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305006aa2 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.407351:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305006aa2 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.407359:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.407361:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.407363:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305006aa2 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.407368:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305006aa2 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.407378:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305006aa9 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.407382:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305006aa9 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.407390:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305006aa9 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.407395:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59f3c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.407396:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305006aa9 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.407401:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305006aa9 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.407406:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x60ff3b22 (ffff880129f26c00) 00010000:00010000:1.0:1715205775.407408:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.407409:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305006aa9 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.407413:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305006aa9 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.407435:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305006a9b lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2338c expref: 102 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.407440:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305006a9b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2338c expref: 102 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.407447:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59e640, rc 0) 00010000:00000080:1.0:1715205775.407451:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910e84c0 x1798520455743168/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 656/600 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.407495:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910e84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+101:11754:x1798520455743168:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 347us (456us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205775.407502:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1733 00000100:00100000:0.0:1715205775.408567:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.408648:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455743232 00000100:00100000:1.0:1715205775.408676:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1734 00000100:00100000:1.0:1715205775.408680:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910e9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+101:11754:x1798520455743232:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.408689:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.408698:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af4305006ab0 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23393 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.408725:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305006ab7 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.408732:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305006ab7 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.408739:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305006ab7 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.408747:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305006abe lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.408765:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305006abe lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.408770:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305006abe lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.408810:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305006ab7 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.408819:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305006ab7 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.408824:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305006ab7 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.408829:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099172f40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.408831:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305006ab7 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.408836:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305006ab7 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.408842:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.408844:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.408847:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305006ab7 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.408856:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305006ab7 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.408866:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305006abe lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.408870:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305006abe lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.408875:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305006abe lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.408883:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099170d80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.408884:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305006abe lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.408889:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305006abe lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.408895:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x60b23c20 (ffff880129f26a00) 00010000:00010000:1.0:1715205775.408897:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.408898:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305006abe lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.408902:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305006abe lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.408933:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af4305006ab0 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23393 expref: 102 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.408939:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af4305006ab0 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23393 expref: 102 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.408946:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099173a80, rc 0) 00010000:00000080:1.0:1715205775.408950:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910e9300 x1798520455743232/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.408993:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910e9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+101:11754:x1798520455743232:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 313us (428us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205775.408999:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1734 00000100:00100000:1.0:1715205775.410371:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455743360 00000100:00100000:1.0:1715205775.410402:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1735 00000100:00100000:1.0:1715205775.410406:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+101:11754:x1798520455743360:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.410418:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.410419:0:14185:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1715205775.410433:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af4305006a40 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23369 expref: 101 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.410444:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.410447:0:14185:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205775.410453:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305006ac5 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2339a expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.410529:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af4305006acc lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.410537:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af4305006acc lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.410549:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af4305006acc lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.410559:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305006ad3 lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.410564:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305006ad3 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.410569:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305006ad3 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715205775.411062:0:14185:0:(osp_object.c:1645:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x100010000:0x15d8:0x0], index 1: 0 00010000:00010000:1.0:1715205775.411224:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800991733c0/0xb608af4305006ada lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.411231:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800991733c0/0xb608af4305006ada lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.411236:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800991733c0/0xb608af4305006ada lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.411261:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af4305006acc lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.411266:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af4305006acc lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.411270:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af4305006acc lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.411275:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800991721c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.411277:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af4305006acc lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.411282:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af4305006acc lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.411289:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.411291:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.411293:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af4305006acc lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.411297:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af4305006acc lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715205775.411305:0:14185:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff880137119c80 reply state ffff8800a73e0000 transno 330712482546 ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305006ad3 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.411324:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305006ac5 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2339a expref: 103 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.411332:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800991733c0/0xb608af4305006ada lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2339a expref: 102 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.411337:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100e:0x0].0x0 (ffff880129f26400) 00010000:00010000:1.0:1715205775.411339:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1715205775.411340:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800991733c0, rc 0) 00010000:00000080:1.0:1715205775.411344:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880137119c80 x1798520455743360/t330712482546(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 656/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.411394:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+103:11754:x1798520455743360:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 987us (1079us total) trans 330712482546 rc 0/0 00000100:00100000:1.0:1715205775.411400:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1735 00000100:00100000:1.0:1715205775.412710:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455743424 00000100:00100000:1.0:1715205775.412733:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1736 00000100:00100000:1.0:1715205775.412736:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364ad0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+102:11754:x1798520455743424:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.412749:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.412773:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af4305006ae8 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b233a1 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.412823:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006aef lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.412831:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006aef lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.412838:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006aef lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205775.412860:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205775.412869:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006aef lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.412874:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006aef lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.412886:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af4305006ae8 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233a1 expref: 104 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.412892:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006aef lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233a1 expref: 103 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.412896:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100e:0x0].0x0 (ffff880129f26400) 00010000:00010000:1.0:1715205775.412897:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205775.412898:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099170fc0, rc 0) 00010000:00000080:1.0:1715205775.412901:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364ad0c0 x1798520455743424/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.412940:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364ad0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+103:11754:x1798520455743424:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 203us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.412944:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1736 00000100:00100000:0.0:1715205775.414344:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.415935:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.416016:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455743616 00000100:00100000:3.0:1715205775.416039:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 455 00000100:00100000:3.0:1715205775.416041:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ed580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+103:11754:x1798520455743616:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:3.0:1715205775.416215:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910ed580 x1798520455743616/t330712482547(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.416239:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ed580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+104:11754:x1798520455743616:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 198us (307us total) trans 330712482547 rc 0/0 00000100:00100000:3.0:1715205775.416243:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 455 00000100:00100000:0.0:1715205775.417743:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.417867:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455743744 00000100:00100000:1.0:1715205775.417907:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1737 00000100:00100000:1.0:1715205775.417911:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d910050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+104:11754:x1798520455743744:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.417924:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.417936:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170000/0xb608af4305006afd lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b233af expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.417993:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af4305006b04 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.418004:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006aef lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233a1 expref: 105 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.418009:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af4305006b04 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.418036:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006aef lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233a1 expref: 105 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.418045:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006aef lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233a1 expref: 105 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.418054:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fcc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456027392:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.418100:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b4480 going to sleep for 6 seconds 00000100:00100000:1.0:1715205775.418948:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fcc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456027392:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205775.418960:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af4305006b04 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.419169:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:1.0:1715205775.419392:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af4305006b04 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.419398:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af4305006b04 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205775.419408:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x100e:0x0]: returning size 0 00010000:00010000:1.0:1715205775.419492:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170000/0xb608af4305006afd lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233af expref: 106 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.419502:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af4305006b04 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233af expref: 105 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.419507:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100e:0x0].0x0 (ffff880129f26400) 00010000:00010000:1.0:1715205775.419509:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205775.419510:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099170900, rc 0) 00010000:00000080:1.0:1715205775.419513:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d910050 x1798520455743744/t330712482548(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.419533:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d910050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+105:11754:x1798520455743744:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1622us (1794us total) trans 330712482548 rc 0/0 00000100:00100000:1.0:1715205775.419538:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1737 00000100:00100000:0.0:1715205775.420872:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.420935:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455743872 00000100:00100000:1.0:1715205775.420976:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1738 00000100:00100000:1.0:1715205775.420980:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ee880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+105:11754:x1798520455743872:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.420993:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.421001:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099171b00/0xb608af4305006b12 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b233b6 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.421032:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305006b19 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.421041:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af4305006b04 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233af expref: 106 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.421046:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305006b19 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.421063:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af4305006b04 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233af expref: 106 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.421071:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af4305006b04 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233af expref: 106 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.421078:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fcc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456027456:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.421115:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b4480 going to sleep for 6 seconds 00000100:00100000:1.0:1715205775.422006:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fcc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456027456:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205775.422020:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305006b19 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.422207:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:1.0:1715205775.422382:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305006b19 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.422390:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305006b19 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205775.422418:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x100e:0x0]: returning size 0 00000004:00200000:1.0:1715205775.422421:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205775.422432:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305006b19 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.422439:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305006b19 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.422454:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099171b00/0xb608af4305006b12 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233b6 expref: 106 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.422464:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305006b19 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233b6 expref: 105 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.422468:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100e:0x0].0x0 (ffff880129f26400) 00010000:00010000:1.0:1715205775.422469:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205775.422471:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099171680, rc 0) 00010000:00000080:1.0:1715205775.422474:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910ee880 x1798520455743872/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.422574:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ee880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+105:11754:x1798520455743872:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1593us (1706us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.422579:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1738 00000100:00100000:0.0:1715205775.423850:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.425430:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.426710:0:8315:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801364af200 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8315:1798520456027584:192.168.204.8@tcp:105: 00010000:00010000:0.0:1715205775.426723:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205775.426749:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910eaf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+52:1830:x1798520455744064:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 1252us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.426766:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4654 00000100:00100000:1.0:1715205775.427346:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.427431:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455744192 00000100:00100000:3.0:1715205775.427514:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 456 00000100:00100000:3.0:1715205775.427518:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372fcc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+105:11754:x1798520455744192:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:3.0:1715205775.427855:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801372fcc00 x1798520455744192/t330712482549(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.427915:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372fcc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+106:11754:x1798520455744192:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 395us (569us total) trans 330712482549 rc 0/0 00000100:00100000:3.0:1715205775.427923:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 456 00000100:00100000:1.0:1715205775.429292:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455744320 00000100:00100000:1.0:1715205775.429329:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1739 00000100:00100000:1.0:1715205775.429334:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364ac740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+106:11754:x1798520455744320:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.429351:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.429364:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305006b27 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b233c4 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.429437:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af4305006b2e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.429450:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305006b19 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233b6 expref: 107 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.429455:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af4305006b2e lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.429480:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305006b19 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233b6 expref: 107 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.429490:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305006b19 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233b6 expref: 107 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.429500:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fe880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456027648:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.429545:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b4480 going to sleep for 6 seconds 00000100:00100000:1.0:1715205775.431315:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fe880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456027648:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205775.431335:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af4305006b2e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.431997:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455744384 00010000:00010000:0.0:1715205775.432026:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305006b19 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233b6 expref: 108 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.432054:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4655 00000100:00100000:0.0:1715205775.432060:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364acc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+108:1830:x1798520455744384:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1715205775.432071:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.432076:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305006b19 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233b6 expref: 108 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.432085:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305006b19 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233b6 expref: 108 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.432102:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305006b19 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233b6 expref: 108 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.432115:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100e:0x0].0x0 (ffff880129f26400) 00010000:00010000:0.0:1715205775.432119:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af4305006b2e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.432126:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af4305006b2e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.432133:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af4305006b2e lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.432154:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205775.432175:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af4305006b2e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.432180:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af4305006b2e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205775.432201:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x100e:0x0]: returning size 2048 00000100:00100000:0.0:1715205775.432207:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364acc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+107:1830:x1798520455744384:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 147us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.432213:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4655 00010000:00010000:1.0:1715205775.432319:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305006b27 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233c4 expref: 108 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.432348:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af4305006b2e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233c4 expref: 107 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.432354:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100e:0x0].0x0 (ffff880129f26400) 00010000:00010000:1.0:1715205775.432356:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205775.432358:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099172400, rc 0) 00010000:00000080:1.0:1715205775.432362:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364ac740 x1798520455744320/t330712482550(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.432397:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364ac740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+107:11754:x1798520455744320:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 3063us (3175us total) trans 330712482550 rc 0/0 00000100:00100000:1.0:1715205775.432404:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1739 00000100:00100000:1.0:1715205775.434372:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455744448 00000100:00100000:1.0:1715205775.434404:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1740 00000100:00100000:1.0:1715205775.434408:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364abdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+107:11754:x1798520455744448:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.434427:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.434438:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305006b3c lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b233cb expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.434483:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099171b00/0xb608af4305006b43 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.434494:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af4305006b2e lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233c4 expref: 108 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.434500:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099171b00/0xb608af4305006b43 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.434525:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af4305006b2e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233c4 expref: 108 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.434535:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af4305006b2e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233c4 expref: 108 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.434545:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fe880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456027712:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.434591:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b4480 going to sleep for 6 seconds 00000100:00100000:0.0:1715205775.437357:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455744512 00010000:00010000:0.0:1715205775.437384:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af4305006b2e lrc: 5/0,0 mode: CW/CW res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233c4 expref: 109 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.437410:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4656 00000100:00100000:0.0:1715205775.437415:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364ab440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+109:1831:x1798520455744512:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205775.437426:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.437431:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af4305006b2e lrc: 5/0,0 mode: CW/CW res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233c4 expref: 109 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.437440:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af4305006b2e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233c4 expref: 109 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.437459:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100e:0x0].0x0 (ffff880129f26400) 00010000:00010000:0.0:1715205775.437463:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099171b00/0xb608af4305006b43 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.437470:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099171b00/0xb608af4305006b43 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.437481:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099171b00/0xb608af4305006b43 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.437496:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205775.437523:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af4305006b2e lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233c4 expref: 109 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.437539:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fe880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456027712:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205775.437546:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364ab440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+108:1831:x1798520455744512:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 130us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.437553:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4656 00010000:00010000:1.0:1715205775.437556:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099171b00/0xb608af4305006b43 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.437562:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099171b00/0xb608af4305006b43 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.437568:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099171b00/0xb608af4305006b43 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205775.437603:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x100e:0x0]: returning size 2048 00000004:00200000:1.0:1715205775.437606:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205775.437645:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099171b00/0xb608af4305006b43 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.437654:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099171b00/0xb608af4305006b43 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.437675:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305006b3c lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233cb expref: 108 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.437686:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099171b00/0xb608af4305006b43 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233cb expref: 107 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.437692:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100e:0x0].0x0 (ffff880129f26400) 00010000:00010000:1.0:1715205775.437694:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205775.437695:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099171b00, rc 0) 00010000:00000080:1.0:1715205775.437701:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364abdc0 x1798520455744448/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.437725:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364abdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+107:11754:x1798520455744448:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 3316us (3440us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.437731:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1740 00000100:00100000:1.0:1715205775.439480:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455744576 00000100:00100000:1.0:1715205775.439502:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1741 00000100:00100000:1.0:1715205775.439505:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364a8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+107:11754:x1798520455744576:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.439517:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.439526:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170000/0xb608af4305006b4a lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b233d2 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.439558:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006b51 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.439568:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006b51 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.439572:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006b51 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.439580:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af4305006b58 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.439584:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af4305006b58 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.439587:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af4305006b58 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.439660:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006b51 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.439663:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006b51 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.439666:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006b51 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.439670:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099170fc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.439672:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006b51 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.439675:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006b51 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.439680:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.439681:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.439683:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006b51 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.439685:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006b51 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.439691:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af4305006b58 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.439693:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af4305006b58 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.439695:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af4305006b58 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.439698:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099170480 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.439699:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af4305006b58 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.439701:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af4305006b58 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.439704:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x98b08880 (ffff880129f26300) 00010000:00010000:1.0:1715205775.439705:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.439705:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af4305006b58 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.439710:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af4305006b58 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.439728:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170000/0xb608af4305006b4a lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233d2 expref: 108 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.439731:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170000/0xb608af4305006b4a lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233d2 expref: 108 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.439735:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099170000, rc 0) 00010000:00000080:1.0:1715205775.439737:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364a8980 x1798520455744576/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.439789:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364a8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+107:11754:x1798520455744576:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 282us (359us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205775.439795:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1741 00000100:00100000:1.0:1715205775.440818:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455744640 00000100:00100000:1.0:1715205775.440843:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1742 00000100:00100000:1.0:1715205775.440846:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+107:11754:x1798520455744640:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.440851:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.440856:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305006b5f lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b233d9 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.440868:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305006b5f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233d9 expref: 108 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.440874:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305006b5f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233d9 expref: 108 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.440878:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.440879:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.440880:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099173600, rc 0) 00010000:00000080:1.0:1715205775.440881:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364ada40 x1798520455744640/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 328/344 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.440905:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+108:11754:x1798520455744640:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 58us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.440908:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1742 00000100:00100000:3.0:1715205775.442435:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455744704 00000100:00100000:3.0:1715205775.442472:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 457 00000100:00100000:3.0:1715205775.442478:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364ae880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+108:11754:x1798520455744704:12345-192.168.204.8@tcp:37:dbench.0 00010000:00000080:3.0:1715205775.444438:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364ae880 x1798520455744704/t0(0) o37->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 448/440 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.444478:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364ae880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+108:11754:x1798520455744704:12345-192.168.204.8@tcp:37:dbench.0 Request processed in 1997us (2099us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.444487:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 457 00000100:00100000:3.0:1715205775.446355:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455744832 00000100:00100000:3.0:1715205775.446392:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1743 00000100:00100000:3.0:1715205775.446395:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364a9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+108:11754:x1798520455744832:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.446408:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.446419:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af4305006b66 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b233e0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.446487:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305006b6d lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.446504:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305006b6d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.446516:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305006b6d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.446526:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305006b74 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.446531:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305006b74 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.446536:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305006b74 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.446567:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305006b6d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.446574:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305006b6d lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.446577:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305006b6d lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.446579:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73add40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.446581:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305006b6d lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.446584:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305006b6d lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.446590:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205775.446591:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.446593:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305006b6d lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.446595:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305006b6d lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.446612:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305006b74 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.446615:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305006b74 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.446635:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305006b74 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.446640:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ac900 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.446641:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305006b74 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.446645:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305006b74 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.446650:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x98b08880 (ffff88009399e400) 00010000:00010000:3.0:1715205775.446652:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.446653:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305006b74 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.446657:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305006b74 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.446681:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af4305006b66 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233e0 expref: 109 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.446686:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af4305006b66 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233e0 expref: 109 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.446692:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ac6c0, rc 0) 00010000:00000080:3.0:1715205775.446695:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364a9c80 x1798520455744832/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 656/600 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.446737:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364a9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+108:11754:x1798520455744832:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 339us (473us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205775.446742:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1743 00000100:00100000:3.0:1715205775.447743:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455744896 00000100:00100000:3.0:1715205775.447787:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1744 00000100:00100000:3.0:1715205775.447791:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364af6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+108:11754:x1798520455744896:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.447798:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.447805:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305006b7b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b233e7 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.447830:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305006b82 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.447836:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305006b82 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.447842:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305006b82 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.447850:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305006b89 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.447855:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305006b89 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.447859:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305006b89 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.447893:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305006b82 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.447898:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305006b82 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.447906:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305006b82 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.447910:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73acd80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.447912:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305006b82 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.447916:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305006b82 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.447922:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205775.447924:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.447925:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305006b82 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.447930:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305006b82 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.447938:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305006b89 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.447943:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305006b89 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.447947:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305006b89 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.447951:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ad440 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.447953:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305006b89 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.447957:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305006b89 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.447962:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x4bb1867f (ffff88009399e700) 00010000:00010000:3.0:1715205775.447964:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.447965:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305006b89 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.447969:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305006b89 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.447994:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305006b7b lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233e7 expref: 109 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.447999:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305006b7b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233e7 expref: 109 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.448005:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73aeac0, rc 0) 00010000:00000080:3.0:1715205775.448008:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364af6c0 x1798520455744896/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.448042:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364af6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+108:11754:x1798520455744896:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 250us (341us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205775.448047:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1744 00000100:00100000:3.0:1715205775.449582:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455745024 00000100:00100000:3.0:1715205775.449608:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1745 00000100:00100000:3.0:1715205775.449612:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364aed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+108:11754:x1798520455745024:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.449641:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.449648:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305006b90 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b233ee expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.449693:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af4305006b97 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.449701:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af4305006b97 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.449707:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af4305006b97 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.449715:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305006b9e lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.449720:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305006b9e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.449724:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305006b9e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.449744:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af4305006b97 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.449749:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af4305006b97 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.449764:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af4305006b97 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.449772:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73adf80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.449774:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af4305006b97 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.449779:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af4305006b97 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.449785:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205775.449787:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.449788:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af4305006b97 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.449793:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adf80/0xb608af4305006b97 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.449801:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305006b9e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.449804:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305006b9e lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.449808:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305006b9e lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.449812:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73aed00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.449813:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305006b9e lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.449817:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305006b9e lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.449823:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x4bb1867f (ffff88009399e900) 00010000:00010000:3.0:1715205775.449825:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.449826:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305006b9e lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.449830:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305006b9e lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.449846:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305006b90 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233ee expref: 109 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.449852:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305006b90 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233ee expref: 109 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.449857:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73af3c0, rc 0) 00010000:00000080:3.0:1715205775.449860:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364aed40 x1798520455745024/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 656/600 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.449897:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364aed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+108:11754:x1798520455745024:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 283us (487us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205775.449903:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1745 00000100:00100000:3.0:1715205775.450861:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455745088 00000100:00100000:3.0:1715205775.450885:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1746 00000100:00100000:3.0:1715205775.450887:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364ae3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+108:11754:x1798520455745088:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.450893:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.450897:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006ba5 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b233f5 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.450921:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305006bac lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.450928:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305006bac lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.450933:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305006bac lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.450941:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305006bb3 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.450946:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305006bb3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.450951:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305006bb3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.450976:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305006bac lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.450986:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305006bac lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.450990:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305006bac lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.450994:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73af600 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.450995:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305006bac lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.451000:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305006bac lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.451006:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205775.451009:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.451010:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305006bac lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.451014:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305006bac lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.451020:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305006bb3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.451025:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305006bb3 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.451028:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305006bb3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.451032:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ae400 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.451034:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305006bb3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.451038:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305006bb3 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.451043:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x98b08880 (ffff88009399e000) 00010000:00010000:3.0:1715205775.451045:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.451046:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305006bb3 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.451050:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305006bb3 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.451075:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006ba5 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233f5 expref: 109 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.451079:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006ba5 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233f5 expref: 109 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.451085:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73acfc0, rc 0) 00010000:00000080:3.0:1715205775.451087:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364ae3c0 x1798520455745088/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.451111:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364ae3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+108:11754:x1798520455745088:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 223us (294us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205775.451114:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1746 00000100:00100000:3.0:1715205775.453208:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455745216 00000100:00100000:3.0:1715205775.453265:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1747 00000100:00100000:3.0:1715205775.453271:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+108:11754:x1798520455745216:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.453287:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.453303:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305006bba lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b233fc expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.453395:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305006bc1 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.453407:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305006bc1 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.453415:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305006bc1 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.453426:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006bc8 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.453431:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006bc8 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.453436:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006bc8 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.453469:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305006bc1 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.453474:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305006bc1 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.453479:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305006bc1 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.453484:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ae880 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.453486:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305006bc1 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.453492:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305006bc1 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.453501:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205775.453504:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.453507:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305006bc1 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.453511:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305006bc1 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.453521:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006bc8 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.453526:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006bc8 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.453530:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006bc8 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.453534:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ac000 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.453536:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006bc8 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.453540:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006bc8 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.453546:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x98b08880 (ffff88009399e600) 00010000:00010000:3.0:1715205775.453547:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.453548:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006bc8 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.453552:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006bc8 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.453584:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305006bba lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233fc expref: 109 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.453590:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305006bba lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233fc expref: 109 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.453597:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ac240, rc 0) 00010000:00000080:3.0:1715205775.453601:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364a8000 x1798520455745216/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 656/600 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.453690:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+108:11754:x1798520455745216:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 418us (635us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205775.453696:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1747 00000100:00100000:3.0:1715205775.454846:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455745280 00000100:00100000:3.0:1715205775.454889:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1748 00000100:00100000:3.0:1715205775.454894:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364adf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+108:11754:x1798520455745280:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.454907:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.454920:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006bcf lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23403 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.454957:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305006bd6 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.454967:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305006bd6 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.454975:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305006bd6 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.454984:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305006bdd lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.454988:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305006bdd lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.454992:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305006bdd lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.455037:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305006bd6 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.455042:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305006bd6 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.455045:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305006bd6 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.455050:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ac480 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.455053:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305006bd6 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.455058:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305006bd6 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.455065:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205775.455067:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.455069:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305006bd6 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.455076:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305006bd6 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.455089:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305006bdd lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.455093:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305006bdd lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.455097:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305006bdd lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.455102:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73af840 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.455103:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305006bdd lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.455107:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305006bdd lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.455112:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x4bb1867f (ffff88009399e300) 00010000:00010000:3.0:1715205775.455114:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.455115:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305006bdd lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.455119:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305006bdd lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.455149:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006bcf lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23403 expref: 109 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.455159:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006bcf lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23403 expref: 109 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.455165:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ad200, rc 0) 00010000:00000080:3.0:1715205775.455169:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364adf00 x1798520455745280/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.455229:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364adf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+108:11754:x1798520455745280:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 334us (438us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205775.455234:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1748 00000100:00100000:3.0:1715205775.456588:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455745408 00000100:00100000:3.0:1715205775.456639:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1749 00000100:00100000:3.0:1715205775.456644:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364ab900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+108:11754:x1798520455745408:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.456656:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.456659:0:14860:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1715205775.456676:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305006b5f lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233d9 expref: 108 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.456687:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205775.456689:0:14860:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205775.456696:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af4305006be4 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2340a expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.456776:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305006beb lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.456784:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305006beb lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.456789:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305006beb lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.456797:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305006bf2 lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.456800:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305006bf2 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.456803:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305006bf2 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715205775.457093:0:14860:0:(osp_object.c:1645:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x100000000:0x17b8:0x0], index 0: 0 00010000:00010000:3.0:1715205775.457226:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006bf9 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.457233:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006bf9 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.457239:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006bf9 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.457266:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305006beb lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.457270:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305006beb lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.457275:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305006beb lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.457280:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73aef40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.457283:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305006beb lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.457287:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305006beb lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.457292:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205775.457294:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.457295:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305006beb lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.457298:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305006beb lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715205775.457305:0:14860:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff8801364ab900 reply state ffff880091e1c000 transno 330712482551 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305006bf2 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.457322:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af4305006be4 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2340a expref: 110 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.457330:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006bf9 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2340a expref: 109 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.457334:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100f:0x0].0x0 (ffff88009399e900) 00010000:00010000:3.0:1715205775.457335:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1715205775.457336:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73adb00, rc 0) 00010000:00000080:3.0:1715205775.457339:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364ab900 x1798520455745408/t330712482551(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 656/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.457380:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364ab900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+110:11754:x1798520455745408:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 735us (879us total) trans 330712482551 rc 0/0 00000100:00100000:3.0:1715205775.457386:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1749 00010000:00010000:0.0:1715205775.458362:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305006bf2 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.458374:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305006bf2 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.458380:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305006bf2 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.458385:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73acb40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.458388:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305006bf2 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.458393:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305006bf2 lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.458404:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x4bb1867f (ffff88009399e000) 00010000:00010000:0.0:1715205775.458406:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.458407:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305006bf2 lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.458412:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305006bf2 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.458876:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455745472 00000100:00100000:3.0:1715205775.458918:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1750 00000100:00100000:3.0:1715205775.458924:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364a8e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+109:11754:x1798520455745472:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.458939:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.458950:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305006c07 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23411 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.459034:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af4305006c0e lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.459043:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af4305006c0e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.459050:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af4305006c0e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205775.459075:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205775.459085:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af4305006c0e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.459091:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af4305006c0e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.459104:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305006c07 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23411 expref: 111 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.459120:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af4305006c0e lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23411 expref: 110 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.459125:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100f:0x0].0x0 (ffff88009399e900) 00010000:00010000:3.0:1715205775.459127:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205775.459128:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ad8c0, rc 0) 00010000:00000080:3.0:1715205775.459133:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364a8e40 x1798520455745472/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.459189:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364a8e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+110:11754:x1798520455745472:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 266us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.459194:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1750 00000100:00100000:0.0:1715205775.460881:0:19961:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455745536 00000100:00100000:0.0:1715205775.460936:0:19961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14681 00000100:00100000:0.0:1715205775.460941:0:19961:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+37:1831:x1798520455745536:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.460956:0:19961:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.460974:0:19961:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1200/0xb608af4305006c15 lrc: 2/0,0 mode: --/PR res: [0x17b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23418 expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1715205775.460997:0:19961:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x17b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1715205775.461014:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205775.461016:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205775.461025:0:19961:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1200/0xb608af4305006c15 lrc: 3/0,0 mode: PR/PR res: [0x17b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23418 expref: 38 pid: 19961 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1715205775.461037:0:19961:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1200/0xb608af4305006c15 lrc: 3/0,0 mode: PR/PR res: [0x17b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23418 expref: 38 pid: 19961 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1715205775.461046:0:19961:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c1200, rc 0) 00000100:00100000:0.0:1715205775.461081:0:19961:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099276050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+38:1831:x1798520455745536:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 140us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.461086:0:19961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14681 00000100:00100000:3.0:1715205775.462394:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455745664 00000100:00100000:3.0:1715205775.462435:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 458 00000100:00100000:3.0:1715205775.462440:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364a84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+110:11754:x1798520455745664:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:3.0:1715205775.463194:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364a84c0 x1798520455745664/t330712482552(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.463255:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364a84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+111:11754:x1798520455745664:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 814us (1102us total) trans 330712482552 rc 0/0 00000100:00100000:3.0:1715205775.463261:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 458 00000100:00100000:3.0:1715205775.465163:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455745792 00000100:00100000:3.0:1715205775.465686:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1751 00000100:00100000:3.0:1715205775.465691:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364aaac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+111:11754:x1798520455745792:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.465708:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.465721:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305006c1c lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2341f expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.465795:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006c23 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.465808:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af4305006c0e lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23411 expref: 112 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.465814:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006c23 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.465838:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af4305006c0e lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23411 expref: 112 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.465847:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af4305006c0e lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23411 expref: 112 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.465856:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a66dcc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456027776:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205775.465898:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b9d1c00 going to sleep for 6 seconds 00000100:00100000:0.0:1715205775.467302:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455745856 00000100:00100000:3.0:1715205775.467313:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a66dcc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456027776:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205775.467330:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af4305006c0e lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23411 expref: 113 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.467335:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006c23 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.467357:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4657 00000100:00100000:0.0:1715205775.467362:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364ad0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+113:1830:x1798520455745856:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1715205775.467374:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.467378:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af4305006c0e lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23411 expref: 113 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.467387:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af4305006c0e lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23411 expref: 113 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.467405:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af4305006c0e lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23411 expref: 113 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.467432:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100f:0x0].0x0 (ffff88009399e900) 00010000:00010000:0.0:1715205775.467436:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006c23 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.467442:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006c23 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.467448:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006c23 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.467474:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205775.467505:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364ad0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+112:1830:x1798520455745856:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 143us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.467512:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4657 00000100:00100000:0.0:1715205775.469331:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455745920 00000100:00100000:0.0:1715205775.469370:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1752 00000100:00100000:0.0:1715205775.469375:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364aa140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+112:11754:x1798520455745920:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.469392:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.469404:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af4305006c31 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23426 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.469450:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305006c38 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.469460:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006c23 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2341f expref: 113 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.469465:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305006c38 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.469490:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006c23 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2341f expref: 113 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.469499:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006c23 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2341f expref: 113 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.469511:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800910e9c80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456027840:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205775.469568:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b547000 going to sleep for 6 seconds 00000100:00100000:0.0:1715205775.470928:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455745984 00010000:00010000:0.0:1715205775.470944:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006c23 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2341f expref: 114 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.470968:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4658 00000100:00100000:0.0:1715205775.470972:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364a97c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+114:1831:x1798520455745984:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1715205775.470979:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.470982:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006c23 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2341f expref: 114 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.470994:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006c23 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2341f expref: 114 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.471008:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006c23 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2341f expref: 114 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.471018:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100f:0x0].0x0 (ffff88009399e900) 00010000:00010000:0.0:1715205775.471020:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305006c38 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.471026:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305006c38 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.471031:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305006c38 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.471051:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205775.471075:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364a97c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+113:1831:x1798520455745984:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 103us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.471081:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4658 00000100:00100000:0.0:1715205775.472444:0:19961:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455746048 00000100:00100000:0.0:1715205775.472493:0:19961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14682 00000100:00100000:0.0:1715205775.472498:0:19961:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364af200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+38:11754:x1798520455746048:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.472512:0:19961:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.472528:0:19961:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1d40/0xb608af4305006c3f lrc: 2/0,0 mode: --/PW res: [0x17b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2342d expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.472556:0:19961:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1200/0xb608af4305006c15 lrc: 2/0,0 mode: PR/PR res: [0x17b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23418 expref: 39 pid: 19961 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1715205775.472562:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205775.472564:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205775.472566:0:19961:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1d40/0xb608af4305006c3f lrc: 4/0,0 mode: --/PW res: [0x17b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2342d expref: 39 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.472590:0:19961:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1200/0xb608af4305006c15 lrc: 3/0,0 mode: PR/PR res: [0x17b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23418 expref: 39 pid: 19961 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1715205775.472600:0:19961:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1200/0xb608af4305006c15 lrc: 4/0,0 mode: PR/PR res: [0x17b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23418 expref: 39 pid: 19961 timeout: 3135 lvb_type: 1 00000100:00100000:0.0:1715205775.472609:0:19961:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800910e97c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:19961:1798520456027904:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205775.472684:0:19961:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b547300 going to sleep for 6 seconds 00000100:00100000:0.0:1715205775.474066:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.474201:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455746112 00010000:00010000:1.0:1715205775.474216:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1200/0xb608af4305006c15 lrc: 4/0,0 mode: PR/PR res: [0x17b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23418 expref: 40 pid: 19961 timeout: 3135 lvb_type: 1 00000100:00100000:1.0:1715205775.474237:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4659 00000100:00100000:1.0:1715205775.474241:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+40:1831:x1798520455746112:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1715205775.474248:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.474263:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1200/0xb608af4305006c15 lrc: 4/0,0 mode: PR/PR res: [0x17b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23418 expref: 39 pid: 19961 timeout: 3135 lvb_type: 1 00010000:00010000:1.0:1715205775.474272:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1200/0xb608af4305006c15 lrc: 3/0,0 mode: PR/PR res: [0x17b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23418 expref: 39 pid: 19961 timeout: 3135 lvb_type: 1 00010000:00010000:1.0:1715205775.474287:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1200/0xb608af4305006c15 lrc: 0/0,0 mode: --/PR res: [0x17b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23418 expref: 39 pid: 19961 timeout: 3135 lvb_type: 1 00010000:00010000:1.0:1715205775.474299:0:8315:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205775.474300:0:8315:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205775.474305:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1d40/0xb608af4305006c3f lrc: 2/0,0 mode: PW/PW res: [0x17b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2342d expref: 38 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.474312:0:8315:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1d40/0xb608af4305006c3f lrc: 3/0,0 mode: PW/PW res: [0x17b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2342d expref: 38 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.474331:0:8315:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1d40/0xb608af4305006c3f lrc: 3/0,0 mode: PW/PW res: [0x17b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2342d expref: 38 pid: 19961 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.474338:0:8315:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fe880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8315:1798520456027968:192.168.204.8@tcp:105: 00000100:00100000:1.0:1715205775.474574:0:8315:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b4480 going to sleep for 6 seconds 00000100:00100000:1.0:1715205775.475353:0:8315:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fe880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8315:1798520456027968:192.168.204.8@tcp:105: 00010000:00010000:1.0:1715205775.475373:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205775.475412:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+38:1831:x1798520455746112:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 1169us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.475418:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4659 00000100:00100000:3.0:1715205775.475847:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.475907:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455746240 00000100:00100000:0.0:1715205775.475943:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 459 00000100:00100000:0.0:1715205775.475948:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66dcc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+112:11754:x1798520455746240:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.476191:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a66dcc00 x1798520455746240/t330712482554(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.476224:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66dcc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+113:11754:x1798520455746240:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 276us (378us total) trans 330712482554 rc 0/0 00000100:00100000:0.0:1715205775.476231:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 459 00000100:00100000:3.0:1715205775.477443:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.478979:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d445f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456028032:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205775.478999:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006c4d lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.479048:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455746432 00010000:00010000:1.0:1715205775.479075:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305006c38 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23426 expref: 115 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.479113:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4660 00000100:00100000:1.0:1715205775.479117:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b521f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+115:1831:x1798520455746432:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1715205775.479127:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.479131:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305006c38 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23426 expref: 115 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.479145:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305006c38 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23426 expref: 115 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.479161:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305006c38 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23426 expref: 115 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.479174:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100f:0x0].0x0 (ffff88009399e900) 00010000:00010000:1.0:1715205775.479178:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006c4d lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.479186:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006c4d lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.479191:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006c4d lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.479219:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205775.479242:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006c4d lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.479249:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006c4d lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205775.479261:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x100f:0x0]: returning size 2048 00000100:00100000:1.0:1715205775.479262:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b521f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+114:1831:x1798520455746432:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 144us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.479268:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4660 00010000:00010000:0.0:1715205775.479345:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca1c0/0xb608af4305006c46 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23434 expref: 115 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.479357:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006c4d lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23434 expref: 114 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.479363:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100f:0x0].0x0 (ffff88009399e900) 00010000:00010000:0.0:1715205775.479365:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205775.479366:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940cb600, rc 0) 00010000:00000080:0.0:1715205775.479370:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a66db440 x1798520455746368/t330712482555(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.479405:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66db440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+114:11754:x1798520455746368:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1855us (1966us total) trans 330712482555 rc 0/0 00000100:00100000:0.0:1715205775.479412:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1753 00000100:00100000:0.0:1715205775.480422:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455746496 00000100:00100000:0.0:1715205775.480461:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1754 00000100:00100000:0.0:1715205775.480468:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d446d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+114:11754:x1798520455746496:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.480479:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.480487:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2f40/0xb608af4305006c5b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2343b expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.480518:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305006c62 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.480527:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006c4d lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23434 expref: 115 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.480532:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305006c62 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.480550:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006c4d lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23434 expref: 115 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.480559:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006c4d lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23434 expref: 115 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.480567:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800910ec740 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456028096:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205775.480607:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b547d80 going to sleep for 6 seconds 00000100:00100000:0.0:1715205775.481383:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800910ec740 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456028096:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205775.481396:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305006c62 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.482499:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455746560 00010000:00010000:1.0:1715205775.482517:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006c4d lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23434 expref: 116 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.482540:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4661 00000100:00100000:1.0:1715205775.482543:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d442600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+116:1830:x1798520455746560:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1715205775.482549:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.482551:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006c4d lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23434 expref: 116 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.482557:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006c4d lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23434 expref: 116 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.482567:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006c4d lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23434 expref: 116 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.482574:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100f:0x0].0x0 (ffff88009399e900) 00010000:00010000:1.0:1715205775.482576:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305006c62 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.482581:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305006c62 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.482584:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305006c62 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.482598:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205775.482641:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d442600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+115:1830:x1798520455746560:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 98us (224us total) trans 0 rc 0/0 00010000:00010000:0.0:1715205775.482643:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305006c62 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.482645:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4661 00010000:00010000:0.0:1715205775.482650:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305006c62 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205775.482677:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x100f:0x0]: returning size 2048 00000004:00200000:0.0:1715205775.482682:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205775.482692:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305006c62 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.482699:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305006c62 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.482777:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2f40/0xb608af4305006c5b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2343b expref: 115 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.482787:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305006c62 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2343b expref: 114 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.482791:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100f:0x0].0x0 (ffff88009399e900) 00010000:00010000:0.0:1715205775.482794:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205775.482795:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c1200, rc 0) 00010000:00000080:0.0:1715205775.482798:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d446d40 x1798520455746496/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.482831:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d446d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+114:11754:x1798520455746496:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2365us (2455us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.482837:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1754 00000100:00100000:0.0:1715205775.483973:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455746624 00000100:00100000:0.0:1715205775.483999:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1755 00000100:00100000:0.0:1715205775.484003:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d447200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+114:11754:x1798520455746624:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.484014:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.484023:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af4305006c69 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23442 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.484051:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006c70 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.484059:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006c70 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.484064:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006c70 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.484073:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006c77 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.484077:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006c77 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.484082:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006c77 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.484132:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006c70 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.484138:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006c70 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.484143:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006c70 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.484147:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c06c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.484151:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006c70 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.484156:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006c70 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.484161:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205775.484163:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.484165:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006c70 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.484169:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006c70 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.484177:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006c77 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.484182:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006c77 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.484186:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006c77 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.484189:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c0fc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.484190:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006c77 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.484195:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006c77 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.484199:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x98b08880 (ffff880091e4c500) 00010000:00010000:0.0:1715205775.484202:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.484203:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006c77 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.484207:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006c77 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.484230:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af4305006c69 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23442 expref: 115 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.484236:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af4305006c69 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23442 expref: 115 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.484242:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c0000, rc 0) 00010000:00000080:0.0:1715205775.484245:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d447200 x1798520455746624/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.484286:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d447200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+114:11754:x1798520455746624:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 282us (356us total) trans 0 rc 301/301 00000100:00100000:0.0:1715205775.484291:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1755 00000100:00100000:3.0:1715205775.487252:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.487325:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455746688 00000100:00100000:0.0:1715205775.487380:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1756 00000100:00100000:0.0:1715205775.487385:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66d9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+114:11754:x1798520455746688:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.487402:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.487418:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006c7e lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23449 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.487448:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006c7e lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23449 expref: 115 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.487462:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006c7e lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23449 expref: 115 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.487469:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205775.487471:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.487474:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c3600, rc 0) 00010000:00000080:0.0:1715205775.487478:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a66d9c80 x1798520455746688/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 328/344 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.487531:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66d9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+115:11754:x1798520455746688:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 146us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.487536:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1756 00000100:00100000:3.0:1715205775.489141:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.489195:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455746752 00000100:00100000:0.0:1715205775.489250:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 460 00000100:00100000:0.0:1715205775.489256:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091813050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+115:11754:x1798520455746752:12345-192.168.204.8@tcp:37:dbench.0 00010000:00000080:0.0:1715205775.491818:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880091813050 x1798520455746752/t0(0) o37->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 448/440 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.491961:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091813050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+115:11754:x1798520455746752:12345-192.168.204.8@tcp:37:dbench.0 Request processed in 2704us (2821us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.491969:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 460 00000100:00100000:3.0:1715205775.493497:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.493557:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455746880 00000100:00100000:0.0:1715205775.493612:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1757 00000100:00100000:0.0:1715205775.493641:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66daac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+115:11754:x1798520455746880:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.493659:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.493678:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af4305006c85 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23450 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.493799:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3180/0xb608af4305006c8c lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.493813:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3180/0xb608af4305006c8c lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.493823:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3180/0xb608af4305006c8c lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.493835:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006c93 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.493840:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006c93 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.493845:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006c93 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.493882:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3180/0xb608af4305006c8c lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.493889:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3180/0xb608af4305006c8c lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.493894:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3180/0xb608af4305006c8c lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.493899:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c3180 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.493902:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3180/0xb608af4305006c8c lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.493909:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3180/0xb608af4305006c8c lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.493918:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205775.493921:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.493923:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3180/0xb608af4305006c8c lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.493927:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3180/0xb608af4305006c8c lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.493958:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006c93 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.493962:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006c93 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.494035:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006c93 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.494040:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c2640 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.494042:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006c93 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.494048:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006c93 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.494054:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x98b08880 (ffff880091e4c600) 00010000:00010000:0.0:1715205775.494056:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.494058:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006c93 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.494062:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006c93 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.494094:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af4305006c85 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23450 expref: 116 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.494101:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af4305006c85 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23450 expref: 116 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.494107:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c0480, rc 0) 00010000:00000080:0.0:1715205775.494112:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a66daac0 x1798520455746880/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 656/600 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.494171:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66daac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+115:11754:x1798520455746880:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 554us (675us total) trans 0 rc 301/301 00000100:00100000:0.0:1715205775.494177:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1757 00000100:00100000:3.0:1715205775.496235:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.496791:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455747008 00000100:00100000:0.0:1715205775.496835:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 461 00000100:00100000:0.0:1715205775.496841:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66dd0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+115:11754:x1798520455747008:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.496982:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a66dd0c0 x1798520455747008/t330712482556(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.497032:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66dd0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+116:11754:x1798520455747008:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 191us (801us total) trans 330712482556 rc 0/0 00000100:00100000:0.0:1715205775.497038:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 461 00000100:00100000:0.0:1715205775.498900:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455747136 00000100:00100000:0.0:1715205775.498929:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 462 00000100:00100000:0.0:1715205775.498933:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4404c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+116:11754:x1798520455747136:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.499027:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4404c0 x1798520455747136/t330712482557(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.499069:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4404c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+117:11754:x1798520455747136:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 132us (209us total) trans 330712482557 rc 0/0 00000100:00100000:0.0:1715205775.499075:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 462 00000100:00100000:3.0:1715205775.500148:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.500218:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455747264 00000100:00100000:0.0:1715205775.500259:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1758 00000100:00100000:0.0:1715205775.500264:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66ded40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+117:11754:x1798520455747264:12345-192.168.204.8@tcp:36:dbench.0 00010000:00010000:0.0:1715205775.500304:0:14860:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1715205775.500327:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305006c62 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2343b expref: 117 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.500346:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006bf9 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2340a expref: 116 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.500359:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100f:0x0].0x0 (ffff88009399e900) 00010000:00010000:0.0:1715205775.500371:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006c7e lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23449 expref: 115 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.500378:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205775.500380:0:14860:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205775.500402:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305006c9a lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.500413:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305006c9a lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.500421:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305006c9a lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.500432:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305006ca1 lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.500437:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305006ca1 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.500442:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305006ca1 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.500579:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af4305006ca8 lrc: 3/0,1 mode: --/EX res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.500585:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af4305006ca8 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.500590:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af4305006ca8 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1715205775.500968:0:14860:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x134:0x0].72, 64 off12800 00010000:00010000:0.0:1715205775.501013:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305006caf lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.501020:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305006caf lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.501026:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305006caf lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.501033:0:14860:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305006caf lrc: 4/0,1 mode: PW/PW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.501038:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305006caf lrc: 4/0,1 mode: PW/PW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.501042:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305006caf lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.501142:0:14860:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1715205775.501151:0:6665:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715205775.501156:0:6665:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305006caf lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.501163:0:6665:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c18c0 already unused, calling callback (ffffffffa07ff190) 00000004:00010000:0.0:1715205775.501165:0:14860:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff8800a66ded40 reply state ffff88012bf93000 transno 330712482558 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af4305006ca8 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.501166:0:6665:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305006caf lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446612134800702224 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.501172:0:6665:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305006caf lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446612134800702224 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.501180:0:6665:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100f:0x0].0x0 (ffff880091e4c700) 00010000:00010000:3.0:1715205775.501182:0:6665:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715205775.501184:0:6665:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305006caf lrc: 1/0,0 mode: --/PW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.501189:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305006caf lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0x100f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.501214:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305006c9a lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.501220:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305006c9a lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.501226:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305006c9a lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.501230:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c0b40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.501233:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305006c9a lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.501239:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305006c9a lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.501253:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205775.501254:0:6665:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205775.501255:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.501256:0:6665:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205775.501257:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305006c9a lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.501257:0:6665:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205775.501261:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305006c9a lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715205775.501268:0:14860:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff8800a66ded40 reply state ffff88012bf93000 transno 330712482558 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305006ca1 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00000080:0.0:1715205775.501285:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a66ded40 x1798520455747264/t330712482558(0) o36->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 504/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.501335:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66ded40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+116:11754:x1798520455747264:12345-192.168.204.8@tcp:36:dbench.0 Request processed in 1070us (1190us total) trans 330712482558 rc 0/0 00000100:00100000:0.0:1715205775.501341:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1758 00000100:00100000:3.0:1715205775.502861:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.502901:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455747328 00000100:00100000:0.0:1715205775.502957:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1759 00000100:00100000:0.0:1715205775.502961:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66dc280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+115:11754:x1798520455747328:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.502973:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.502982:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af4305006cb6 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23457 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.502998:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3180/0xb608af4305006cbd lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.503006:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3180/0xb608af4305006cbd lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.503013:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3180/0xb608af4305006cbd lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.503144:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af4305006cb6 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23457 expref: 117 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.503156:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3180/0xb608af4305006cbd lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23457 expref: 116 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.503161:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee0:0x0].0x0 (ffff88012d4a6d00) 00010000:00010000:0.0:1715205775.503163:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1715205775.503164:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c3180, rc 0) 00010000:00000080:0.0:1715205775.503167:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a66dc280 x1798520455747328/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 568/1160 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.503209:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66dc280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+116:11754:x1798520455747328:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 247us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.503214:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1759 00000100:00100000:3.0:1715205775.504855:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.504918:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455747392 00000100:00100000:0.0:1715205775.504951:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1760 00000100:00100000:0.0:1715205775.504955:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66daf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+116:11754:x1798520455747392:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.504964:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.504972:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af4305006cc4 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2345e expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.504989:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006ccb lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.505001:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006ccb lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.505007:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006ccb lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.505061:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af4305006cc4 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2345e expref: 118 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.505071:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006ccb lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2345e expref: 117 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.505076:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee1:0x0].0x0 (ffff880099676100) 00010000:00010000:0.0:1715205775.505078:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1715205775.505079:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c0fc0, rc 0) 00010000:00000080:0.0:1715205775.505083:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a66daf80 x1798520455747392/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 568/1160 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.505123:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66daf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+117:11754:x1798520455747392:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 168us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.505129:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1760 00000100:00100000:3.0:1715205775.506369:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.506410:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455747456 00000100:00100000:0.0:1715205775.506433:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1761 00000100:00100000:0.0:1715205775.506435:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66da140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+117:11754:x1798520455747456:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.506442:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.506447:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006cd2 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23465 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.506462:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2f40/0xb608af4305006cd9 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.506467:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2f40/0xb608af4305006cd9 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.506471:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2f40/0xb608af4305006cd9 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.506505:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006cd2 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23465 expref: 119 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.506512:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2f40/0xb608af4305006cd9 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23465 expref: 118 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.506516:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee2:0x0].0x0 (ffff88012d4a6400) 00010000:00010000:0.0:1715205775.506517:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1715205775.506518:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c2f40, rc 0) 00010000:00000080:0.0:1715205775.506520:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a66da140 x1798520455747456/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 568/1160 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.506538:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66da140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+118:11754:x1798520455747456:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 102us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.506541:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1761 00000100:00100000:3.0:1715205775.507711:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.507817:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455747520 00000100:00100000:1.0:1715205775.507894:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1762 00000100:00100000:1.0:1715205775.507900:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66ddf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+118:11754:x1798520455747520:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.507914:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.507928:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af4305006ce0 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2346c expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.507977:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305006ce7 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.507988:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305006ce7 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.507996:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305006ce7 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.508009:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af4305006cee lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x60b25030 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.508015:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af4305006cee lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.508020:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af4305006cee lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.508091:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305006ce7 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.508098:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305006ce7 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.508103:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305006ce7 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.508109:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099172640 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.508112:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305006ce7 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.508120:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305006ce7 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.508129:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.508131:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.508133:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305006ce7 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.508138:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305006ce7 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.508159:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af4305006cee lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.508167:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af4305006cee lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.508171:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af4305006cee lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.508176:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099173a80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.508178:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af4305006cee lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.508182:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af4305006cee lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.508187:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x60b25030 (ffff880129f26300) 00010000:00010000:1.0:1715205775.508189:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.508191:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af4305006cee lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.508195:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af4305006cee lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.508229:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af4305006ce0 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2346c expref: 119 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.508233:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af4305006ce0 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2346c expref: 119 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.508238:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800991721c0, rc 0) 00010000:00000080:1.0:1715205775.508240:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a66ddf00 x1798520455747520/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.508288:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66ddf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+118:11754:x1798520455747520:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 389us (583us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205775.508294:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1762 00000100:00100000:3.0:1715205775.509501:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.509552:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455747584 00000100:00100000:1.0:1715205775.509587:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1763 00000100:00100000:1.0:1715205775.509591:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66d97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+118:11754:x1798520455747584:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.509602:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.509611:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305006cf5 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23473 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.509675:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305006cf5 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23473 expref: 119 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.509747:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305006cf5 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23473 expref: 119 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.509767:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.509769:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.509771:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099170d80, rc 0) 00010000:00000080:1.0:1715205775.509777:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a66d97c0 x1798520455747584/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 328/344 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.509836:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66d97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+119:11754:x1798520455747584:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 244us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.509841:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1763 00000100:00100000:3.0:1715205775.511441:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.511494:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455747648 00000100:00100000:0.0:1715205775.511537:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 463 00000100:00100000:0.0:1715205775.511542:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66dbdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+119:11754:x1798520455747648:12345-192.168.204.8@tcp:37:dbench.0 00010000:00000080:0.0:1715205775.513742:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a66dbdc0 x1798520455747648/t0(0) o37->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 448/440 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.513811:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66dbdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+119:11754:x1798520455747648:12345-192.168.204.8@tcp:37:dbench.0 Request processed in 2269us (2383us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.513819:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 463 00000100:00100000:3.0:1715205775.516317:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.516549:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455747712 00000100:00100000:1.0:1715205775.516609:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1764 00000100:00100000:1.0:1715205775.516614:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66d9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+119:11754:x1798520455747712:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.516656:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.516676:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305006cfc lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2347a expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.516731:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305006d03 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.516744:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305006d03 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.516765:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305006d03 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.516779:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305006d0a lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.516789:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305006d0a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.516794:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305006d0a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.516863:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305006d03 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.516870:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305006d03 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.516876:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305006d03 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.516882:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099172640 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.516885:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305006d03 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.516891:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305006d03 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.516901:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.516903:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.516906:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305006d03 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.516910:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305006d03 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.516925:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305006d0a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.516930:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305006d0a lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.516935:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305006d0a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.516939:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099173600 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.516941:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305006d0a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.516945:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305006d0a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.516951:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0xec6f74b7 (ffff880129f26e00) 00010000:00010000:1.0:1715205775.516953:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.516954:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305006d0a lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.516958:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305006d0a lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.516994:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305006cfc lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2347a expref: 120 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.517001:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305006cfc lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2347a expref: 120 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.517009:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099172f40, rc 0) 00010000:00000080:1.0:1715205775.517014:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a66d9300 x1798520455747712/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.517065:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66d9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+119:11754:x1798520455747712:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 450us (754us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205775.517071:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1764 00000100:00100000:3.0:1715205775.518348:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.518401:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455747776 00000100:00100000:1.0:1715205775.518423:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1765 00000100:00100000:1.0:1715205775.518425:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66d8e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+119:11754:x1798520455747776:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.518435:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.518441:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170000/0xb608af4305006d11 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23481 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.518464:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af4305006d18 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.518470:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af4305006d18 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.518477:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af4305006d18 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.518500:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006d1f lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x45949197 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.518505:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006d1f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.518514:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006d1f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.518546:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af4305006d18 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.518550:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af4305006d18 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.518554:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af4305006d18 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.518559:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099170480 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.518560:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af4305006d18 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.518564:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af4305006d18 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.518569:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.518571:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.518572:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af4305006d18 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.518576:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af4305006d18 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.518582:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006d1f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.518589:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006d1f lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.518594:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006d1f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.518597:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099170fc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.518598:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006d1f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.518601:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006d1f lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.518605:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x45949197 (ffff880129f26800) 00010000:00010000:1.0:1715205775.518606:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.518607:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006d1f lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.518610:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305006d1f lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.518650:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170000/0xb608af4305006d11 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23481 expref: 120 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.518655:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170000/0xb608af4305006d11 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23481 expref: 120 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.518660:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099170000, rc 0) 00010000:00000080:1.0:1715205775.518664:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a66d8e40 x1798520455747776/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.518696:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66d8e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+119:11754:x1798520455747776:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 270us (350us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205775.518701:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1765 00000100:00100000:3.0:1715205775.521855:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.521966:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455747840 00000100:00100000:0.0:1715205775.522016:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1766 00000100:00100000:0.0:1715205775.522022:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66d84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+119:11754:x1798520455747840:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.522038:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.522052:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af4305006d26 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23488 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.522102:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305006d2d lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.522113:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305006d2d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.522123:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305006d2d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.522133:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006d34 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x45949197 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.522138:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006d34 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.522143:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006d34 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.522194:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305006d2d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.522198:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305006d2d lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.522201:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305006d2d lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.522204:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c0b40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.522205:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305006d2d lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.522209:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305006d2d lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.522214:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205775.522216:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.522218:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305006d2d lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.522222:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305006d2d lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.522247:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006d34 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.522503:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006d34 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.522512:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006d34 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.522515:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c3600 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.522517:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006d34 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.522521:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006d34 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.522526:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x45949197 (ffff88012d6feb00) 00010000:00010000:0.0:1715205775.522528:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.522529:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006d34 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.522533:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006d34 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.522566:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af4305006d26 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23488 expref: 120 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.522572:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af4305006d26 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23488 expref: 120 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.522577:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c1f80, rc 0) 00010000:00000080:0.0:1715205775.522581:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a66d84c0 x1798520455747840/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.522651:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66d84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+119:11754:x1798520455747840:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 628us (802us total) trans 0 rc 301/301 00000100:00100000:0.0:1715205775.522659:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1766 00000100:00100000:3.0:1715205775.524690:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.524741:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455747968 00000100:00100000:0.0:1715205775.524786:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1767 00000100:00100000:0.0:1715205775.524791:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66df6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+119:11754:x1798520455747968:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.524801:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.524811:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305006d3b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2348f expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.524870:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305006d42 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.524881:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5bcc0/0xb608af43050068a3 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232eb expref: 120 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.524886:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305006d42 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.524912:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5bcc0/0xb608af43050068a3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232eb expref: 120 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.524921:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5bcc0/0xb608af43050068a3 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232eb expref: 120 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.524930:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800910ed580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456028160:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205775.524978:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b5470c0 going to sleep for 6 seconds 00000100:00100000:0.0:1715205775.526612:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800910ed580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456028160:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205775.526661:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305006d42 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.526671:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.526714:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455748032 00010000:00010000:1.0:1715205775.526733:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5bcc0/0xb608af43050068a3 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232eb expref: 121 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.526887:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4662 00000100:00100000:1.0:1715205775.526892:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66de880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+121:1831:x1798520455748032:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1715205775.526901:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.526905:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5bcc0/0xb608af43050068a3 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232eb expref: 121 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.526914:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5bcc0/0xb608af43050068a3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232eb expref: 121 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.526928:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5bcc0/0xb608af43050068a3 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232eb expref: 121 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.526940:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100c:0x0].0x0 (ffff88012d4a6900) 00010000:00010000:1.0:1715205775.526943:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305006d42 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.526949:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305006d42 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.526958:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305006d42 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.526983:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205775.527006:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305006d42 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.527013:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305006d42 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205775.527031:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x100c:0x0]: returning size 543 00000100:00100000:1.0:1715205775.527076:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66de880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+120:1831:x1798520455748032:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 183us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.527082:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4662 00010000:00010000:0.0:1715205775.527149:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305006d3b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2348f expref: 121 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.527161:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305006d42 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2348f expref: 120 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.527168:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100c:0x0].0x0 (ffff88012d4a6900) 00010000:00010000:0.0:1715205775.527170:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205775.527172:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c1680, rc 0) 00010000:00000080:0.0:1715205775.527177:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a66df6c0 x1798520455747968/t330712482559(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.527223:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66df6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+120:11754:x1798520455747968:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2432us (2539us total) trans 330712482559 rc 0/0 00000100:00100000:0.0:1715205775.527230:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1767 00000100:00100000:3.0:1715205775.529141:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.529201:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455748096 00000100:00100000:3.0:1715205775.530976:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.531011:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455748160 00010000:00010000:1.0:1715205775.531029:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305006d42 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2348f expref: 122 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.531056:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4663 00000100:00100000:1.0:1715205775.531060:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66d8980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+122:1831:x1798520455748160:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1715205775.531068:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.531072:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305006d42 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2348f expref: 122 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.531079:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305006d42 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2348f expref: 122 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.531092:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305006d42 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2348f expref: 122 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.531103:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100c:0x0].0x0 (ffff88012d4a6900) 00010000:00010000:1.0:1715205775.531106:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca1c0/0xb608af4305006d57 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.531116:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca1c0/0xb608af4305006d57 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.531121:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca1c0/0xb608af4305006d57 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.531143:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205775.531170:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66d8980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+121:1831:x1798520455748160:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 109us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.531177:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4663 00000100:00100000:3.0:1715205775.532552:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.532609:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455748288 00000100:00100000:0.0:1715205775.532690:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 464 00000100:00100000:0.0:1715205775.532695:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66dcc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+120:11754:x1798520455748288:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.532960:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a66dcc00 x1798520455748288/t330712482560(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.533000:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66dcc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+121:11754:x1798520455748288:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 305us (452us total) trans 330712482560 rc 0/0 00000100:00100000:0.0:1715205775.533005:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 464 00000100:00100000:3.0:1715205775.533853:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.535121:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.535186:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455748480 00010000:00010000:1.0:1715205775.535219:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af43050069d0 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2335b expref: 123 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.535252:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4664 00000100:00100000:1.0:1715205775.535257:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a482140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+123:1831:x1798520455748480:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1715205775.535267:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.535271:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af43050069d0 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2335b expref: 123 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.535280:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af43050069d0 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2335b expref: 123 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.535295:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af43050069d0 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2335b expref: 123 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.535306:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100d:0x0].0x0 (ffff88012c0ee800) 00010000:00010000:1.0:1715205775.535309:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006d65 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.535316:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006d65 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.535321:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006d65 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.535344:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205775.535381:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a482140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+122:1831:x1798520455748480:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 123us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.535386:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4664 00000100:00100000:3.0:1715205775.536365:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.537840:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.537902:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455748608 00010000:00010000:1.0:1715205775.537924:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006d65 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2349d expref: 124 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.537963:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4665 00000100:00100000:1.0:1715205775.537967:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a481300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+124:1830:x1798520455748608:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1715205775.537976:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.537980:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006d65 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2349d expref: 124 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.537988:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006d65 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2349d expref: 124 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.538002:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006d65 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2349d expref: 124 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.538017:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100d:0x0].0x0 (ffff88012c0ee800) 00010000:00010000:1.0:1715205775.538021:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006d7a lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.538028:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006d7a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.538034:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006d7a lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.538050:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205775.538087:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a481300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+123:1830:x1798520455748608:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 120us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.538093:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4665 00000100:00100000:3.0:1715205775.539512:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.539597:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455748736 00000100:00100000:0.0:1715205775.539680:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 465 00000100:00100000:0.0:1715205775.539685:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a483440 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+122:11754:x1798520455748736:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.539849:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009a483440 x1798520455748736/t330712482562(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.539878:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a483440 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+123:11754:x1798520455748736:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 193us (369us total) trans 330712482562 rc 0/0 00000100:00100000:0.0:1715205775.539884:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 465 00000100:00100000:3.0:1715205775.541704:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.541746:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455748864 00000100:00100000:0.0:1715205775.541779:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 466 00000100:00100000:0.0:1715205775.541782:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091817850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+123:11754:x1798520455748864:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.541869:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880091817850 x1798520455748864/t330712482563(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.541904:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091817850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+124:11754:x1798520455748864:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 122us (206us total) trans 330712482563 rc 0/0 00000100:00100000:0.0:1715205775.541908:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 466 00000100:00100000:3.0:1715205775.542704:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.542742:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455748992 00000100:00100000:0.0:1715205775.542784:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 467 00000100:00100000:0.0:1715205775.542788:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a484c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+124:11754:x1798520455748992:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.542963:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009a484c00 x1798520455748992/t330712482564(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.543006:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a484c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+125:11754:x1798520455748992:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 218us (303us total) trans 330712482564 rc 0/0 00000100:00100000:0.0:1715205775.543012:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 467 00000100:00100000:3.0:1715205775.543791:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.543831:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455749120 00000100:00100000:0.0:1715205775.543850:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 468 00000100:00100000:0.0:1715205775.543854:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a483900 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+125:11754:x1798520455749120:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.543970:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009a483900 x1798520455749120/t330712482565(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.543998:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a483900 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+126:11754:x1798520455749120:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 144us (211us total) trans 330712482565 rc 0/0 00000100:00100000:0.0:1715205775.544005:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 468 00000100:00100000:3.0:1715205775.544662:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.544695:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455749248 00000100:00100000:0.0:1715205775.544712:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 469 00000100:00100000:0.0:1715205775.544716:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a480e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+126:11754:x1798520455749248:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.544792:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009a480e40 x1798520455749248/t330712482566(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.544818:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a480e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+127:11754:x1798520455749248:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 102us (158us total) trans 330712482566 rc 0/0 00000100:00100000:0.0:1715205775.544822:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 469 00000100:00100000:3.0:1715205775.546363:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.546408:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455749376 00000100:00100000:0.0:1715205775.546441:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 470 00000100:00100000:0.0:1715205775.546445:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a482f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+127:11754:x1798520455749376:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.546642:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009a482f80 x1798520455749376/t330712482567(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.546682:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a482f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:11754:x1798520455749376:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 235us (323us total) trans 330712482567 rc 0/0 00000100:00100000:0.0:1715205775.546687:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 470 00000100:00100000:0.0:1715205775.547647:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455749504 00000100:00100000:0.0:1715205775.547687:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 471 00000100:00100000:0.0:1715205775.547693:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d441c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:11754:x1798520455749504:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.547893:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d441c80 x1798520455749504/t330712482568(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.547941:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d441c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+129:11754:x1798520455749504:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 248us (398us total) trans 330712482568 rc 0/0 00000100:00100000:0.0:1715205775.547947:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 471 00000100:00100000:3.0:1715205775.549277:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:1.0:1715205775.550009:0:6664:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715205775.550013:0:6664:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9440/0xb608af4305006d96 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446612135023065872 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.550019:0:6664:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940c9440 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:1.0:1715205775.550021:0:6664:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9440/0xb608af4305006d96 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446612135023065872 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.550027:0:6664:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9440/0xb608af4305006d96 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446612135023065872 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.550034:0:6664:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100d:0x0].0x0 (ffff88012bf50b00) 00010000:00010000:1.0:1715205775.550036:0:6664:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1715205775.550038:0:6664:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9440/0xb608af4305006d96 lrc: 1/0,0 mode: --/PW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446612135023065872 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.550042:0:6664:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9440/0xb608af4305006d96 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446612135023065872 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.550060:0:6664:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205775.550061:0:6664:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205775.550062:0:6664:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715205775.550155:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.550157:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006d81 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.550161:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006d81 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715205775.550168:0:14185:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88009a483440 reply state ffff88009a1c4000 transno 330712482569 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006d88 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00000080:2.0:1715205775.550181:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009a483440 x1798520455749632/t330712482569(0) o36->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 504/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.550223:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a483440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:11754:x1798520455749632:12345-192.168.204.8@tcp:36:dbench.0 Request processed in 867us (948us total) trans 330712482569 rc 0/0 00000100:00100000:2.0:1715205775.550229:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1771 00010000:00010000:0.0:1715205775.551319:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006d88 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.551332:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006d88 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.551337:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006d88 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.551342:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940c9f80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.551345:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006d88 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.551350:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006d88 lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.551366:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x17a4f95f (ffff88012bf50500) 00010000:00010000:0.0:1715205775.551368:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.551371:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006d88 lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.551375:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006d88 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.551390:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af4305006d8f lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.551392:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:0.0:1715205775.551395:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af4305006d8f lrc: 2/0,0 mode: EX/EX res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.551399:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af4305006d8f lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.551403:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940ca880 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.551405:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af4305006d8f lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.551409:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af4305006d8f lrc: 4/0,0 mode: EX/EX res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.551415:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100d:0x0].0x0 (ffff88012bf50b00) 00010000:00010000:0.0:1715205775.551417:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715205775.551418:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af4305006d8f lrc: 2/0,0 mode: --/EX res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.551426:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af4305006d8f lrc: 0/0,0 mode: --/EX res: [0x20001b1b3:0x100d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205775.551477:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455749696 00000100:00100000:2.0:1715205775.551501:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1772 00000100:00100000:2.0:1715205775.551505:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+127:11754:x1798520455749696:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.551519:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.551528:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305006d9d lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b234ab expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.551564:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006da4 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.551572:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006da4 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.551577:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006da4 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.551586:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305006dab lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.551590:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305006dab lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.551593:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305006dab lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.551660:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006da4 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.551663:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006da4 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.551666:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006da4 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.551669:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940c98c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.551670:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006da4 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.551672:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006da4 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.551676:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205775.551677:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.551678:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006da4 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.551684:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006da4 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.551691:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305006dab lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.551696:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305006dab lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.551700:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305006dab lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.551704:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940c8480 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.551706:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305006dab lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.551710:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305006dab lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.551716:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x54f6b75a (ffff88012bf50a00) 00010000:00010000:2.0:1715205775.551717:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.551718:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305006dab lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.551723:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305006dab lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.551769:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305006d9d lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234ab expref: 128 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.551780:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305006d9d lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234ab expref: 128 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.551788:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940cb840, rc 0) 00010000:00000080:2.0:1715205775.551791:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1770000 x1798520455749696/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.551839:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1770000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+127:11754:x1798520455749696:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 333us (449us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205775.551845:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1772 00000100:00100000:3.0:1715205775.552657:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.552698:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455749760 00000100:00100000:2.0:1715205775.552721:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1773 00000100:00100000:2.0:1715205775.552725:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1770e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+127:11754:x1798520455749760:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.552732:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.552738:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cba80/0xb608af4305006db2 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b234b2 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.552765:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cba80/0xb608af4305006db2 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234b2 expref: 128 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.552775:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cba80/0xb608af4305006db2 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234b2 expref: 128 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.552779:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205775.552781:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.552782:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940cba80, rc 0) 00010000:00000080:2.0:1715205775.552785:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1770e40 x1798520455749760/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 328/344 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.552851:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1770e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:11754:x1798520455749760:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 125us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.552857:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1773 00000100:00100000:0.0:1715205775.554212:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.554278:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455749824 00000100:00100000:2.0:1715205775.554329:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 472 00000100:00100000:2.0:1715205775.554334:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091816050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:11754:x1798520455749824:12345-192.168.204.8@tcp:37:dbench.0 00010000:00000080:2.0:1715205775.556503:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880091816050 x1798520455749824/t0(0) o37->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 448/440 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.556562:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091816050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:11754:x1798520455749824:12345-192.168.204.8@tcp:37:dbench.0 Request processed in 2227us (2351us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.556572:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 472 00000100:00100000:3.0:1715205775.558084:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.558130:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455749888 00000100:00100000:2.0:1715205775.558168:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1774 00000100:00100000:2.0:1715205775.558172:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1774c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:11754:x1798520455749888:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.558188:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.558204:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9440/0xb608af4305006db9 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b234b9 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558254:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8900/0xb608af4305006dc0 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558265:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8900/0xb608af4305006dc0 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558273:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8900/0xb608af4305006dc0 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558289:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af4305006dc7 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5538fb88 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558295:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af4305006dc7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558300:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af4305006dc7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558511:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006dce lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558518:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006dce lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558524:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006dce lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205775.558548:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee4:0x0]: returning size 260096 00000004:00200000:2.0:1715205775.558551:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205775.558565:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006dce lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558574:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006dce lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558581:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8900/0xb608af4305006dc0 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558585:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8900/0xb608af4305006dc0 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558591:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8900/0xb608af4305006dc0 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558597:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940c8900 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.558600:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8900/0xb608af4305006dc0 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558605:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8900/0xb608af4305006dc0 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558614:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205775.558636:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.558640:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8900/0xb608af4305006dc0 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558644:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8900/0xb608af4305006dc0 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558654:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af4305006dc7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558658:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af4305006dc7 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558662:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af4305006dc7 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558666:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940c9d40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.558667:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af4305006dc7 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558672:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af4305006dc7 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558678:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x5538fb88 (ffff88012bf50d00) 00010000:00010000:2.0:1715205775.558680:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.558681:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af4305006dc7 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558685:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af4305006dc7 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558707:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9440/0xb608af4305006db9 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234b9 expref: 130 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558717:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006dce lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234b9 expref: 129 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.558722:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:2.0:1715205775.558723:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205775.558724:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940caac0, rc 0) 00010000:00000080:2.0:1715205775.558728:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1774c00 x1798520455749888/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.558778:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1774c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+129:11754:x1798520455749888:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 605us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.558784:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1774 00000100:00100000:0.0:1715205775.560207:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.560260:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455750016 00000100:00100000:2.0:1715205775.560291:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1775 00000100:00100000:2.0:1715205775.560296:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ed580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+129:11754:x1798520455750016:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.560306:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.560315:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af4305006dd5 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b234c0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.560364:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ddc lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.560372:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006dce lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234b9 expref: 130 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.560377:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ddc lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.560407:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006dce lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234b9 expref: 130 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.560417:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006dce lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234b9 expref: 130 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.560428:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d441c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456028416:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205775.560481:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a5c00600 going to sleep for 6 seconds 00000100:00100000:2.0:1715205775.561592:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d441c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456028416:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205775.561646:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ddc lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.561777:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.561859:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455750080 00010000:00010000:1.0:1715205775.561889:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006dce lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234b9 expref: 131 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.561929:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4666 00000100:00100000:1.0:1715205775.561933:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ec740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+131:1831:x1798520455750080:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1715205775.561944:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.561948:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006dce lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234b9 expref: 131 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.561956:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006dce lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234b9 expref: 131 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.561972:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006dce lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234b9 expref: 131 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.561985:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:1.0:1715205775.561988:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ddc lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.561998:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ddc lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.562004:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ddc lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.562026:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205775.562045:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ddc lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.562058:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ddc lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.562067:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ec740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+130:1831:x1798520455750080:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 133us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.562073:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4666 00000004:00200000:2.0:1715205775.562074:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee4:0x0]: returning size 260096 00010000:00010000:2.0:1715205775.562188:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af4305006dd5 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234c0 expref: 131 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.562199:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ddc lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234c0 expref: 130 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.562205:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:2.0:1715205775.562206:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205775.562208:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940c9200, rc 0) 00010000:00000080:2.0:1715205775.562212:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910ed580 x1798520455750016/t330712482570(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.562248:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ed580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+130:11754:x1798520455750016:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1952us (2045us total) trans 330712482570 rc 0/0 00000100:00100000:2.0:1715205775.562254:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1775 00000100:00100000:0.0:1715205775.563542:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.563597:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455750144 00000100:00100000:2.0:1715205775.563715:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1776 00000100:00100000:2.0:1715205775.563720:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ecc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+130:11754:x1798520455750144:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.563735:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.563745:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af4305006dea lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b234c7 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.563790:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006df1 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.563800:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ddc lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234c0 expref: 131 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.563805:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006df1 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.563825:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ddc lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234c0 expref: 131 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.563833:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ddc lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234c0 expref: 131 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.563841:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d441c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456028480:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205775.563878:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a5c00600 going to sleep for 6 seconds 00000100:00100000:2.0:1715205775.565073:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d441c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456028480:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205775.565093:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006df1 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.565222:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.565275:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455750208 00010000:00010000:1.0:1715205775.565291:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ddc lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234c0 expref: 132 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.565316:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4667 00000100:00100000:1.0:1715205775.565321:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b521b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+132:1831:x1798520455750208:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1715205775.565328:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.565331:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ddc lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234c0 expref: 132 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.565339:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ddc lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234c0 expref: 132 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.565351:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ddc lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234c0 expref: 132 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.565362:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:1.0:1715205775.565365:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006df1 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.565371:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006df1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.565375:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006df1 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.565388:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205775.565398:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006df1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.565403:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006df1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.565417:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b521b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+131:1831:x1798520455750208:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 95us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.565423:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4667 00000004:00200000:2.0:1715205775.565431:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee4:0x0]: returning size 260096 00000004:00200000:2.0:1715205775.565434:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205775.565446:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006df1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.565454:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006df1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.565469:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af4305006dea lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234c7 expref: 131 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.565478:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006df1 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234c7 expref: 130 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.565483:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:2.0:1715205775.565485:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205775.565487:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940ca640, rc 0) 00010000:00000080:2.0:1715205775.565490:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910ecc00 x1798520455750144/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.565525:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ecc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+130:11754:x1798520455750144:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1805us (1986us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.565530:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1776 00000100:00100000:0.0:1715205775.566894:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.566958:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455750272 00000100:00100000:2.0:1715205775.567002:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1777 00000100:00100000:2.0:1715205775.567007:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ed0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+130:11754:x1798520455750272:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.567024:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.567039:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8d80/0xb608af4305006df8 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b234ce expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.567084:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8000/0xb608af4305006dff lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.567099:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8000/0xb608af4305006dff lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.567109:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8000/0xb608af4305006dff lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.567696:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006e06 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.567704:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006e06 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.567711:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006e06 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.567784:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8000/0xb608af4305006dff lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.567790:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8000/0xb608af4305006dff lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.567795:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8000/0xb608af4305006dff lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.567799:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940c8000 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.567802:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8000/0xb608af4305006dff lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.567807:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8000/0xb608af4305006dff lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.567816:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205775.567818:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.567820:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8000/0xb608af4305006dff lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.567825:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8000/0xb608af4305006dff lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.567835:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006e06 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.567839:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006e06 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.567844:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006e06 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.567848:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940c8b40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.567850:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006e06 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.567855:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006e06 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.567859:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x54f6b75a (ffff8800b40eb500) 00010000:00010000:2.0:1715205775.567861:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.567861:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006e06 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.567870:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006e06 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.567902:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8d80/0xb608af4305006df8 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234ce expref: 131 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.567907:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8d80/0xb608af4305006df8 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234ce expref: 131 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.567912:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940c8d80, rc 0) 00010000:00000080:2.0:1715205775.567917:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910ed0c0 x1798520455750272/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.567972:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ed0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+130:11754:x1798520455750272:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 964us (1079us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205775.567978:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1777 00000100:00100000:3.0:1715205775.569046:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.569089:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455750400 00000100:00100000:2.0:1715205775.569124:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 473 00000100:00100000:2.0:1715205775.569129:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1776880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+130:11754:x1798520455750400:12345-192.168.204.8@tcp:35:dbench.0 00000001:00080000:2.0:1715205775.569360:0:14188:0:(tgt_lastrcvd.c:2017:tgt_txn_stop_cb()) More than one transaction 330712482571 00010000:00000080:2.0:1715205775.569388:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1776880 x1798520455750400/t330712482571(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.569421:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1776880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+131:11754:x1798520455750400:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 292us (378us total) trans 330712482571 rc 0/0 00000100:00100000:2.0:1715205775.569427:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 473 00000100:00100000:3.0:1715205775.570289:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.570332:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455750528 00000100:00100000:2.0:1715205775.570361:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1778 00000100:00100000:2.0:1715205775.570365:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a17763c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+131:11754:x1798520455750528:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.570375:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.570386:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006e0d lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b234d5 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.570441:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006e14 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.570452:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006df1 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234c7 expref: 132 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.570458:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006e14 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.570489:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006df1 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234c7 expref: 132 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.570499:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006df1 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234c7 expref: 132 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.570509:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d441c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456028544:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205775.570555:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a5c00600 going to sleep for 6 seconds 00000100:00100000:2.0:1715205775.571486:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d441c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456028544:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205775.571509:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006e14 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.571560:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.571647:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455750592 00010000:00010000:1.0:1715205775.571663:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006df1 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234c7 expref: 133 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.571688:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4668 00000100:00100000:1.0:1715205775.571692:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1771300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+133:1830:x1798520455750592:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1715205775.571700:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.571704:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006df1 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234c7 expref: 133 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.571712:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006df1 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234c7 expref: 133 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.571725:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006df1 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234c7 expref: 133 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.571740:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:1.0:1715205775.571742:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006e14 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.571761:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006e14 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.571767:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006e14 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.571787:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205775.571799:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006e14 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.571806:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006e14 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.571815:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1771300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+132:1830:x1798520455750592:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 122us (257us total) trans 0 rc 0/0 00000004:00200000:2.0:1715205775.571819:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee4:0x0]: returning size 260096 00000100:00100000:1.0:1715205775.571824:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4668 00010000:00010000:2.0:1715205775.571906:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006e0d lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234d5 expref: 133 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.571917:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006e14 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234d5 expref: 132 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.571923:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:2.0:1715205775.571925:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205775.571926:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940cad00, rc 0) 00010000:00000080:2.0:1715205775.571930:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a17763c0 x1798520455750528/t330712482572(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.571964:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a17763c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+132:11754:x1798520455750528:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1598us (1675us total) trans 330712482572 rc 0/0 00000100:00100000:2.0:1715205775.571970:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1778 00000100:00100000:3.0:1715205775.573430:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.573487:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455750656 00000100:00100000:2.0:1715205775.573525:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1779 00000100:00100000:2.0:1715205775.573530:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1777200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+132:11754:x1798520455750656:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.573547:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.573559:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af4305006e22 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b234dc expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.573603:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af4305006e29 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.573614:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006e14 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234d5 expref: 133 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.573640:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af4305006e29 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.573664:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006e14 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234d5 expref: 133 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.573675:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006e14 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234d5 expref: 133 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.573684:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d441c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456028608:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205775.573733:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a5c00600 going to sleep for 6 seconds 00000100:00100000:2.0:1715205775.574722:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d441c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456028608:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205775.574765:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af4305006e29 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.575082:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.575177:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455750720 00010000:00010000:1.0:1715205775.575204:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006e14 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234d5 expref: 134 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.575240:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4669 00000100:00100000:1.0:1715205775.575245:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1773900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+134:1830:x1798520455750720:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1715205775.575255:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.575259:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006e14 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234d5 expref: 134 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.575268:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006e14 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234d5 expref: 134 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.575288:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006e14 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234d5 expref: 134 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.575300:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:1.0:1715205775.575303:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af4305006e29 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.575309:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af4305006e29 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.575314:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af4305006e29 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.575342:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205775.575379:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1773900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+133:1830:x1798520455750720:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 134us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.575385:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4669 00010000:00010000:3.0:1715205775.575489:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af4305006e29 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.575501:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af4305006e29 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205775.575540:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee4:0x0]: returning size 260096 00000004:00200000:3.0:1715205775.575544:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205775.575560:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af4305006e29 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.575568:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af4305006e29 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.575590:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af4305006e22 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234dc expref: 133 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.575643:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af4305006e29 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234dc expref: 132 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.575650:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:3.0:1715205775.575652:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205775.575654:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940cb3c0, rc 0) 00010000:00000080:3.0:1715205775.575659:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1777200 x1798520455750656/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.575706:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1777200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+132:11754:x1798520455750656:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2175us (2277us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.575714:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1779 00000100:00100000:3.0:1715205775.577309:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.577354:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455750784 00000100:00100000:0.0:1715205775.577398:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1780 00000100:00100000:0.0:1715205775.577403:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1772ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+132:11754:x1798520455750784:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.577419:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.577434:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305006e30 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b234e3 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577478:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305006e37 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577488:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305006e37 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577497:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305006e37 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577510:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af4305006e3e lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x554f0788 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577519:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af4305006e3e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577525:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af4305006e3e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577784:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006e45 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577791:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006e45 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577797:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006e45 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205775.577813:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee5:0x0]: returning size 260096 00000004:00200000:0.0:1715205775.577816:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205775.577827:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006e45 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577834:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006e45 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577840:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305006e37 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577844:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305006e37 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577849:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305006e37 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577855:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c1200 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.577859:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305006e37 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577864:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305006e37 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577871:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205775.577873:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.577875:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305006e37 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577879:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305006e37 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577906:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af4305006e3e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577911:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af4305006e3e lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577915:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af4305006e3e lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577918:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c1f80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.577919:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af4305006e3e lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577923:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af4305006e3e lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577929:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x554f0788 (ffff8800a5d65200) 00010000:00010000:0.0:1715205775.577931:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.577932:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af4305006e3e lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577936:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af4305006e3e lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577958:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305006e30 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234e3 expref: 134 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577966:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006e45 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234e3 expref: 133 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.577972:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee5:0x0].0x0 (ffff8800a5d65a00) 00010000:00010000:0.0:1715205775.577974:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205775.577975:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c3600, rc 0) 00010000:00000080:0.0:1715205775.577979:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1772ac0 x1798520455750784/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.578086:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1772ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+133:11754:x1798520455750784:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 682us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.578093:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1780 00000100:00100000:0.0:1715205775.579537:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.579637:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455750912 00000100:00100000:2.0:1715205775.579669:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1781 00000100:00100000:2.0:1715205775.579674:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ef6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+133:11754:x1798520455750912:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.579690:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.579705:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006e4c lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b234ea expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.579782:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af4305006e53 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.579794:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006e45 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234e3 expref: 134 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.579800:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af4305006e53 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.579824:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006e45 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234e3 expref: 134 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.579833:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006e45 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234e3 expref: 134 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.579841:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d441c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456028672:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205775.579891:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a5c00600 going to sleep for 6 seconds 00000100:00100000:1.0:1715205775.581509:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.581646:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455750976 00010000:00010000:3.0:1715205775.581670:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006e45 lrc: 5/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234e3 expref: 135 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.581702:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4670 00000100:00100000:3.0:1715205775.581706:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372fe880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+135:1830:x1798520455750976:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205775.581716:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.581719:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006e45 lrc: 5/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234e3 expref: 135 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.581728:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006e45 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234e3 expref: 135 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.581743:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee5:0x0].0x0 (ffff8800a5d65a00) 00010000:00010000:3.0:1715205775.581746:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af4305006e53 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.581764:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af4305006e53 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.581769:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af4305006e53 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.581784:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205775.581880:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305006e45 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234e3 expref: 135 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.581892:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d441c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456028672:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205775.581911:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af4305006e53 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.581917:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af4305006e53 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.581921:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af4305006e53 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205775.581936:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee5:0x0]: returning size 260096 00010000:00010000:2.0:1715205775.582044:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006e4c lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234ea expref: 136 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.582055:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af4305006e53 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234ea expref: 135 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.582059:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee5:0x0].0x0 (ffff8800a5d65a00) 00010000:00010000:2.0:1715205775.582061:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205775.582062:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940c9b00, rc 0) 00010000:00000080:2.0:1715205775.582066:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910ef6c0 x1798520455750912/t330712482573(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.582164:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372fe880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+135:1830:x1798520455750976:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 456us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.582170:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4670 00000100:00100000:2.0:1715205775.582221:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ef6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+134:11754:x1798520455750912:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2547us (2689us total) trans 330712482573 rc 0/0 00000100:00100000:2.0:1715205775.582226:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1781 00000100:00100000:3.0:1715205775.583727:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.583801:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455751040 00000100:00100000:2.0:1715205775.583848:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1782 00000100:00100000:2.0:1715205775.583854:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1774740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+134:11754:x1798520455751040:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.583876:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.583892:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af4305006e61 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b234f1 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.583945:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9440/0xb608af4305006e68 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.583957:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af4305006e53 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234ea expref: 135 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.583963:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9440/0xb608af4305006e68 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.583993:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af4305006e53 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234ea expref: 135 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.584002:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af4305006e53 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234ea expref: 135 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.584013:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d441c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456028736:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205775.584074:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a5c00600 going to sleep for 6 seconds 00000100:00100000:2.0:1715205775.584878:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d441c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456028736:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205775.584901:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9440/0xb608af4305006e68 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.585132:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.585199:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455751104 00010000:00010000:0.0:1715205775.585220:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af4305006e53 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234ea expref: 136 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.585251:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4671 00000100:00100000:0.0:1715205775.585255:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1772f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+136:1831:x1798520455751104:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205775.585263:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.585267:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af4305006e53 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234ea expref: 136 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.585275:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af4305006e53 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234ea expref: 136 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.585290:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af4305006e53 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234ea expref: 136 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.585302:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee5:0x0].0x0 (ffff8800a5d65a00) 00010000:00010000:0.0:1715205775.585305:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9440/0xb608af4305006e68 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.585311:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9440/0xb608af4305006e68 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.585316:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9440/0xb608af4305006e68 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.585342:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205775.585368:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1772f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+135:1831:x1798520455751104:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 113us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.585374:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4671 00010000:00010000:2.0:1715205775.585513:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9440/0xb608af4305006e68 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.585519:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9440/0xb608af4305006e68 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205775.585561:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee5:0x0]: returning size 260096 00000004:00200000:2.0:1715205775.585565:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205775.585584:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9440/0xb608af4305006e68 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.585592:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9440/0xb608af4305006e68 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.585611:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af4305006e61 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234f1 expref: 135 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.585651:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9440/0xb608af4305006e68 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234f1 expref: 134 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.585656:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee5:0x0].0x0 (ffff8800a5d65a00) 00010000:00010000:2.0:1715205775.585658:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205775.585660:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940c9440, rc 0) 00010000:00000080:2.0:1715205775.585665:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1774740 x1798520455751040/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.585701:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1774740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+134:11754:x1798520455751040:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1847us (1981us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.585706:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1782 00000100:00100000:3.0:1715205775.587001:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.587099:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455751168 00000100:00100000:2.0:1715205775.587146:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1783 00000100:00100000:2.0:1715205775.587152:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a17776c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+134:11754:x1798520455751168:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.587167:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.587183:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af4305006e6f lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b234f8 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.587385:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8900/0xb608af4305006e76 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.587402:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8900/0xb608af4305006e76 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.587416:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8900/0xb608af4305006e76 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.587428:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305006e7d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x853e0f88 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.587433:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305006e7d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.587438:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305006e7d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.588952:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305006e84 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.588962:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305006e84 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.588969:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305006e84 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205775.588988:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee6:0x0]: returning size 260096 00000004:00200000:2.0:1715205775.588990:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205775.589002:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305006e84 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.589009:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305006e84 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.589014:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8900/0xb608af4305006e76 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.589020:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8900/0xb608af4305006e76 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.589026:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8900/0xb608af4305006e76 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.589031:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940c8900 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.589033:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8900/0xb608af4305006e76 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.589038:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8900/0xb608af4305006e76 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.589046:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205775.589048:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.589051:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8900/0xb608af4305006e76 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.589055:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8900/0xb608af4305006e76 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.589064:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305006e7d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.589068:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305006e7d lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.589073:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305006e7d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.589081:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940cb840 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.589082:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305006e7d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.589087:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305006e7d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.589091:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x853e0f88 (ffff88008f367f00) 00010000:00010000:2.0:1715205775.589093:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.589094:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305006e7d lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.589097:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305006e7d lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.589119:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af4305006e6f lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234f8 expref: 136 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.589128:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305006e84 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234f8 expref: 135 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.589133:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee6:0x0].0x0 (ffff88008f367800) 00010000:00010000:2.0:1715205775.589134:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205775.589135:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940c8480, rc 0) 00010000:00000080:2.0:1715205775.589141:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a17776c0 x1798520455751168/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.589202:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a17776c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+135:11754:x1798520455751168:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2049us (2204us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.589209:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1783 00000100:00100000:0.0:1715205775.591216:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.591853:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455751296 00000100:00100000:2.0:1715205775.591886:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1784 00000100:00100000:2.0:1715205775.591891:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ea600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+135:11754:x1798520455751296:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.591906:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.591920:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006e8b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b234ff expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.591983:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006e92 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.591995:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305006e84 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234f8 expref: 136 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.592001:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006e92 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.592025:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305006e84 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234f8 expref: 136 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.592035:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305006e84 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234f8 expref: 136 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.592044:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d441c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456028800:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205775.592100:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a5c00000 going to sleep for 6 seconds 00000100:00100000:0.0:1715205775.595441:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.595476:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455751360 00010000:00010000:0.0:1715205775.595499:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305006e84 lrc: 5/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234f8 expref: 137 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.595524:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4672 00000100:00100000:0.0:1715205775.595528:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ec280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+137:1831:x1798520455751360:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1715205775.595538:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.595542:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305006e84 lrc: 5/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234f8 expref: 137 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.595550:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305006e84 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234f8 expref: 137 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.595565:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee6:0x0].0x0 (ffff88008f367800) 00010000:00010000:0.0:1715205775.595568:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006e92 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.595575:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006e92 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.595580:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006e92 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.595593:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205775.595644:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ec280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+137:1831:x1798520455751360:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 114us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.595650:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4672 00010000:00010000:2.0:1715205775.595741:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305006e84 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234f8 expref: 136 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.595767:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d441c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456028800:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205775.595786:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006e92 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.595792:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006e92 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.595796:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006e92 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205775.595810:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee6:0x0]: returning size 260096 00010000:00010000:2.0:1715205775.595908:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006e8b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234ff expref: 137 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.595917:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006e92 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234ff expref: 136 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.595922:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee6:0x0].0x0 (ffff88008f367800) 00010000:00010000:2.0:1715205775.595924:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205775.595925:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940cb600, rc 0) 00010000:00000080:2.0:1715205775.595929:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910ea600 x1798520455751296/t330712482574(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.595962:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ea600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+136:11754:x1798520455751296:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 4070us (4750us total) trans 330712482574 rc 0/0 00000100:00100000:2.0:1715205775.595967:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1784 00000100:00100000:0.0:1715205775.597361:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.597429:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455751424 00000100:00100000:2.0:1715205775.597613:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1785 00000100:00100000:2.0:1715205775.597636:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ea140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+136:11754:x1798520455751424:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.597649:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.597659:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af4305006ea0 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23506 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.597691:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006ea7 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.597700:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006e92 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234ff expref: 137 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.597705:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006ea7 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.597727:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006e92 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234ff expref: 137 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.597737:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006e92 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234ff expref: 137 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.597745:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d441c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456028864:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205775.597804:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a5c00000 going to sleep for 6 seconds 00000100:00100000:2.0:1715205775.598767:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d441c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456028864:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205775.598784:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006ea7 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.598826:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.598875:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455751488 00010000:00010000:2.0:1715205775.598889:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006e92 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234ff expref: 138 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.598914:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4673 00000100:00100000:2.0:1715205775.598917:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910eb900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+138:1830:x1798520455751488:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1715205775.598924:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205775.598927:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006e92 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234ff expref: 138 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.598935:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006e92 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234ff expref: 138 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.598946:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006e92 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234ff expref: 138 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.598957:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee6:0x0].0x0 (ffff88008f367800) 00010000:00010000:2.0:1715205775.598959:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006ea7 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.598965:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006ea7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.598971:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006ea7 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.598995:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205775.599020:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910eb900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+137:1830:x1798520455751488:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 102us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.599028:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4673 00010000:00010000:0.0:1715205775.599031:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006ea7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.599041:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006ea7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205775.599083:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee6:0x0]: returning size 260096 00000004:00200000:0.0:1715205775.599087:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205775.599106:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006ea7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.599116:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006ea7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.599138:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af4305006ea0 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23506 expref: 137 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.599151:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006ea7 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23506 expref: 136 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.599157:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee6:0x0].0x0 (ffff88008f367800) 00010000:00010000:0.0:1715205775.599159:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205775.599161:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940c9f80, rc 0) 00010000:00000080:0.0:1715205775.599166:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910ea140 x1798520455751424/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.599217:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ea140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+136:11754:x1798520455751424:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1598us (1860us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.599225:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1785 00000100:00100000:0.0:1715205775.601297:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.601360:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455751552 00000100:00100000:2.0:1715205775.601399:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1786 00000100:00100000:2.0:1715205775.601404:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ebdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+136:11754:x1798520455751552:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.601416:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.601428:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cbcc0/0xb608af4305006eae lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2350d expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601465:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006eb5 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601475:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006eb5 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601482:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006eb5 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601492:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ebc lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x853e1088 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601497:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ebc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601501:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ebc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601698:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006ec3 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601706:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006ec3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601715:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006ec3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205775.601732:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee7:0x0]: returning size 260096 00000004:00200000:2.0:1715205775.601735:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205775.601745:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006ec3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601767:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006ec3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601772:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006eb5 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601776:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006eb5 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601780:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006eb5 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601784:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940c8240 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.601786:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006eb5 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601791:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006eb5 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601799:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205775.601801:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.601803:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006eb5 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601807:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006eb5 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601818:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ebc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601821:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ebc lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601825:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ebc lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601829:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940c9200 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.601830:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ebc lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601833:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ebc lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601837:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x853e1088 (ffff88008f367d00) 00010000:00010000:2.0:1715205775.601838:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.601839:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ebc lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601842:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006ebc lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601861:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cbcc0/0xb608af4305006eae lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2350d expref: 138 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601871:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006ec3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2350d expref: 137 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.601876:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee7:0x0].0x0 (ffff88008f367600) 00010000:00010000:2.0:1715205775.601877:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205775.601878:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940cad00, rc 0) 00010000:00000080:2.0:1715205775.601882:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910ebdc0 x1798520455751552/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.601915:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ebdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+137:11754:x1798520455751552:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 510us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.601920:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1786 00000100:00100000:3.0:1715205775.603661:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.603819:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455751680 00000100:00100000:2.0:1715205775.604077:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1787 00000100:00100000:2.0:1715205775.604082:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1775a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+137:11754:x1798520455751680:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.604095:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.604108:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006eca lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23514 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.604169:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006ed1 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.604180:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006ec3 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2350d expref: 138 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.604185:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006ed1 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.604214:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006ec3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2350d expref: 138 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.604224:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006ec3 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2350d expref: 138 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.604232:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d441c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456028928:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205775.604424:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099fb1cc0 going to sleep for 6 seconds 00000100:00100000:2.0:1715205775.605321:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d441c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456028928:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205775.605337:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006ed1 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.605726:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.606099:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455751744 00010000:00010000:2.0:1715205775.606119:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006ec3 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2350d expref: 139 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.606151:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4674 00000100:00100000:2.0:1715205775.606155:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b521b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+139:1831:x1798520455751744:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1715205775.606164:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205775.606168:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006ec3 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2350d expref: 139 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.606176:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006ec3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2350d expref: 139 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.606189:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006ec3 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2350d expref: 139 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.606201:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee7:0x0].0x0 (ffff88008f367600) 00010000:00010000:2.0:1715205775.606204:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006ed1 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.606210:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006ed1 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.606216:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006ed1 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.606246:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205775.606281:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b521b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+138:1831:x1798520455751744:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 125us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.606287:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4674 00010000:00010000:3.0:1715205775.606382:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006ed1 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.606387:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006ed1 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205775.606401:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee7:0x0]: returning size 260096 00010000:00010000:3.0:1715205775.606505:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006eca lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23514 expref: 139 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.606523:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006ed1 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23514 expref: 138 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.606531:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee7:0x0].0x0 (ffff88008f367600) 00010000:00010000:3.0:1715205775.606533:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1715205775.606534:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940caac0, rc 0) 00010000:00000080:3.0:1715205775.606538:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1775a40 x1798520455751680/t330712482575(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.606558:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1775a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+138:11754:x1798520455751680:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2477us (2902us total) trans 330712482575 rc 0/0 00000100:00100000:3.0:1715205775.606563:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1787 00000100:00100000:1.0:1715205775.608690:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.608824:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455751808 00000100:00100000:3.0:1715205775.608863:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1788 00000100:00100000:3.0:1715205775.608868:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+138:11754:x1798520455751808:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.608882:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.608893:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305006edf lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2351b expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.608932:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305006ee6 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.608942:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006ed1 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23514 expref: 139 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.608947:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305006ee6 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.608970:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006ed1 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23514 expref: 139 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.608978:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006ed1 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23514 expref: 139 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.608987:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1771c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456028992:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205775.609073:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b9d1c00 going to sleep for 6 seconds 00000100:00100000:0.0:1715205775.609933:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.609935:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1771c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456028992:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205775.609959:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305006ee6 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.609976:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455751872 00010000:00010000:1.0:1715205775.609990:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006ed1 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23514 expref: 140 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.610015:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4675 00000100:00100000:1.0:1715205775.610017:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910e8980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+140:1831:x1798520455751872:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1715205775.610023:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.610025:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006ed1 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23514 expref: 140 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.610031:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006ed1 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23514 expref: 140 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.610040:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006ed1 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23514 expref: 140 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.610057:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee7:0x0].0x0 (ffff88008f367600) 00010000:00010000:1.0:1715205775.610059:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305006ee6 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.610064:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305006ee6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.610067:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305006ee6 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.610083:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205775.610102:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910e8980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+139:1831:x1798520455751872:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 84us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.610106:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4675 00010000:00010000:3.0:1715205775.610113:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305006ee6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.610120:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305006ee6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205775.610161:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee7:0x0]: returning size 260096 00000004:00200000:3.0:1715205775.610164:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205775.610176:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305006ee6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.610184:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305006ee6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.610203:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af4305006edf lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2351b expref: 139 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.610223:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305006ee6 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2351b expref: 138 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.610229:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee7:0x0].0x0 (ffff88008f367600) 00010000:00010000:3.0:1715205775.610231:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205775.610233:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73afa80, rc 0) 00010000:00000080:3.0:1715205775.610238:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801372fda40 x1798520455751808/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.610283:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+138:11754:x1798520455751808:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1415us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.610290:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1788 00000100:00100000:0.0:1715205775.611642:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.611694:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455751936 00000100:00100000:3.0:1715205775.611728:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1789 00000100:00100000:3.0:1715205775.611733:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910eed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+138:11754:x1798520455751936:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.611759:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.611770:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305006eed lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23522 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.611856:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af4305006ef4 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.611867:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af4305006ef4 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.611874:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af4305006ef4 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.611884:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006efb lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x863e0f88 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.611888:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006efb lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.611892:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006efb lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.612045:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006f02 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.612050:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006f02 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.612055:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006f02 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205775.612070:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee8:0x0]: returning size 260096 00000004:00200000:3.0:1715205775.612073:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205775.612083:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006f02 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.612089:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006f02 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.612094:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af4305006ef4 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.612098:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af4305006ef4 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.612102:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af4305006ef4 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.612106:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73afcc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.612108:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af4305006ef4 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.612112:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af4305006ef4 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.612118:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205775.612120:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.612122:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af4305006ef4 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.612125:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af4305006ef4 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.612136:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006efb lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.612140:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006efb lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.612149:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006efb lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.612152:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73adb00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.612154:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006efb lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.612158:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006efb lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.612163:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x863e0f88 (ffff88009399e600) 00010000:00010000:3.0:1715205775.612165:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.612166:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006efb lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.612170:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af4305006efb lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.612193:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305006eed lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23522 expref: 140 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.612202:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006f02 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23522 expref: 139 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.612207:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee8:0x0].0x0 (ffff88009399e700) 00010000:00010000:3.0:1715205775.612209:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205775.612210:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ae640, rc 0) 00010000:00000080:3.0:1715205775.612214:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910eed40 x1798520455751936/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.612251:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910eed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+139:11754:x1798520455751936:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 518us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.612258:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1789 00000100:00100000:0.0:1715205775.613850:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.614070:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455752064 00000100:00100000:3.0:1715205775.614095:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1790 00000100:00100000:3.0:1715205775.614099:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910eb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+139:11754:x1798520455752064:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.614111:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.614119:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af4305006f09 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23529 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.614682:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af4305006f10 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.614693:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006f02 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23522 expref: 140 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.614699:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af4305006f10 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.614724:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006f02 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23522 expref: 140 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.614733:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006f02 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23522 expref: 140 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.614743:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1771c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456029056:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205775.614803:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b9d1b40 going to sleep for 6 seconds 00000100:00100000:3.0:1715205775.616435:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1771c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456029056:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205775.616462:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af4305006f10 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.616466:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.616552:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455752128 00010000:00010000:2.0:1715205775.616580:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006f02 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23522 expref: 141 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.616675:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4676 00000100:00100000:2.0:1715205775.616680:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372fa600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+141:1831:x1798520455752128:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1715205775.616693:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205775.616698:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006f02 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23522 expref: 141 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.616706:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006f02 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23522 expref: 141 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.616728:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305006f02 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23522 expref: 141 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.616763:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee8:0x0].0x0 (ffff88009399e700) 00010000:00010000:2.0:1715205775.616766:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af4305006f10 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.616774:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af4305006f10 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.616780:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af4305006f10 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.616802:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205775.616815:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af4305006f10 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.616821:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af4305006f10 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205775.616837:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee8:0x0]: returning size 260096 00000100:00100000:2.0:1715205775.616846:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372fa600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+140:1831:x1798520455752128:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 166us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.616851:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4676 00010000:00010000:3.0:1715205775.616969:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af4305006f09 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23529 expref: 141 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.616983:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af4305006f10 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23529 expref: 140 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.616988:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee8:0x0].0x0 (ffff88009399e700) 00010000:00010000:3.0:1715205775.616990:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1715205775.616992:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73af180, rc 0) 00010000:00000080:3.0:1715205775.616995:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910eb440 x1798520455752064/t330712482576(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.617036:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910eb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+140:11754:x1798520455752064:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2936us (3188us total) trans 330712482576 rc 0/0 00000100:00100000:3.0:1715205775.617042:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1790 00000100:00100000:1.0:1715205775.617899:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.617931:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455752192 00000100:00100000:3.0:1715205775.617957:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1791 00000100:00100000:3.0:1715205775.617960:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372fb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+140:11754:x1798520455752192:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.617976:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.617983:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305006f1e lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23530 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.618019:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006f25 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.618025:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af4305006f10 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23529 expref: 141 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.618029:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006f25 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.618046:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af4305006f10 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23529 expref: 141 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.618053:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af4305006f10 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23529 expref: 141 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.618061:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1771c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456029120:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205775.618096:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b9d1b40 going to sleep for 6 seconds 00000100:00100000:3.0:1715205775.619228:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1771c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456029120:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205775.619244:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006f25 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.619388:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.619480:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455752256 00010000:00010000:2.0:1715205775.619498:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af4305006f10 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23529 expref: 142 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.619517:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4677 00000100:00100000:2.0:1715205775.619521:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372faac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+142:1830:x1798520455752256:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1715205775.619529:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205775.619532:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af4305006f10 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23529 expref: 142 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.619549:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af4305006f10 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23529 expref: 142 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.619560:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af4305006f10 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23529 expref: 142 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.619569:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee8:0x0].0x0 (ffff88009399e700) 00010000:00010000:2.0:1715205775.619572:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006f25 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.619577:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006f25 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.619583:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006f25 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.619740:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006f25 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.619758:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006f25 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.619764:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:3.0:1715205775.619790:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee8:0x0]: returning size 260096 00000004:00200000:3.0:1715205775.619794:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205775.619809:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006f25 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.619817:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006f25 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205775.619830:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372faac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+142:1830:x1798520455752256:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 303us (438us total) trans 0 rc 0/0 00010000:00010000:3.0:1715205775.619835:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aef40/0xb608af4305006f1e lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23530 expref: 142 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205775.619840:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4677 00010000:00010000:3.0:1715205775.619848:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006f25 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23530 expref: 141 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.619853:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee8:0x0].0x0 (ffff88009399e700) 00010000:00010000:3.0:1715205775.619855:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205775.619857:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ad200, rc 0) 00010000:00000080:3.0:1715205775.619862:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801372fb440 x1798520455752192/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.619886:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372fb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+140:11754:x1798520455752192:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1925us (1988us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.619891:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1791 00000100:00100000:0.0:1715205775.621043:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.621084:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455752320 00000100:00100000:3.0:1715205775.621106:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1792 00000100:00100000:3.0:1715205775.621110:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ec280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+140:11754:x1798520455752320:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.621123:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.621135:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305006f2c lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23537 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621171:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305006f33 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621179:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305006f33 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621184:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305006f33 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621192:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305006f3a lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x863e1088 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621195:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305006f3a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621199:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305006f3a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621373:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006f41 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621377:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006f41 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621380:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006f41 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205775.621389:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee9:0x0]: returning size 260096 00000004:00200000:3.0:1715205775.621392:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205775.621397:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006f41 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621402:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006f41 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621407:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305006f33 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621409:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305006f33 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621412:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305006f33 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621415:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ac480 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.621417:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305006f33 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621420:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305006f33 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621425:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205775.621427:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.621428:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305006f33 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621431:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af4305006f33 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621442:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305006f3a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621447:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305006f3a lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621450:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305006f3a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621452:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ac240 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205775.621453:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305006f3a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621455:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305006f3a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621458:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x863e1088 (ffff88009399ef00) 00010000:00010000:3.0:1715205775.621459:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.621459:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305006f3a lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621461:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305006f3a lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621476:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305006f2c lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23537 expref: 142 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621481:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006f41 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23537 expref: 141 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.621484:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee9:0x0].0x0 (ffff88009399e100) 00010000:00010000:3.0:1715205775.621486:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205775.621487:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ac000, rc 0) 00010000:00000080:3.0:1715205775.621489:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910ec280 x1798520455752320/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.621521:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ec280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+141:11754:x1798520455752320:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 411us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.621525:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1792 00000100:00100000:2.0:1715205775.622911:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.622976:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455752448 00000100:00100000:3.0:1715205775.623013:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1793 00000100:00100000:3.0:1715205775.623017:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d441c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+141:11754:x1798520455752448:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.623029:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.623045:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305006f48 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2353e expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.623107:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006f4f lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.623116:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006f41 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23537 expref: 142 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.623121:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006f4f lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.623151:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006f41 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23537 expref: 142 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.623163:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006f41 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23537 expref: 142 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.623178:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1771c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456029184:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205775.623229:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b9d10c0 going to sleep for 6 seconds 00000100:00100000:3.0:1715205775.624196:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1771c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456029184:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205775.624213:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006f4f lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205775.624602:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.624699:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455752512 00010000:00010000:0.0:1715205775.624723:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006f41 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23537 expref: 143 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.624769:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4678 00000100:00100000:0.0:1715205775.624774:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d440000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+143:1831:x1798520455752512:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1715205775.624784:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.624789:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006f41 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23537 expref: 143 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.624797:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006f41 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23537 expref: 143 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.624815:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305006f41 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23537 expref: 143 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.624845:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee9:0x0].0x0 (ffff88009399e100) 00010000:00010000:0.0:1715205775.624848:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006f4f lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.624854:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006f4f lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.624859:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006f4f lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.624873:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205775.624907:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d440000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+142:1831:x1798520455752512:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 133us (307us total) trans 0 rc 0/0 00010000:00010000:2.0:1715205775.624907:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006f4f lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.624913:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4678 00010000:00010000:2.0:1715205775.624915:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006f4f lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205775.624934:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee9:0x0]: returning size 260096 00010000:00010000:2.0:1715205775.625049:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305006f48 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2353e expref: 143 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.625060:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006f4f lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2353e expref: 142 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.625065:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee9:0x0].0x0 (ffff88009399e100) 00010000:00010000:2.0:1715205775.625067:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205775.625068:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73acfc0, rc 0) 00010000:00000080:2.0:1715205775.625071:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d441c80 x1798520455752448/t330712482577(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.625100:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d441c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+142:11754:x1798520455752448:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2083us (2193us total) trans 330712482577 rc 0/0 00000100:00100000:2.0:1715205775.625104:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1793 00000100:00100000:2.0:1715205775.626124:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.626141:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455752576 00000100:00100000:0.0:1715205775.626163:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1794 00000100:00100000:0.0:1715205775.626167:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d442140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+142:11754:x1798520455752576:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.626181:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.626189:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305006f5d lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23545 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.626223:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006f64 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.626231:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006f4f lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2353e expref: 143 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.626236:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006f64 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.626255:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006f4f lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2353e expref: 143 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.626263:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006f4f lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2353e expref: 143 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.626272:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800910eb900 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456029248:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205775.626310:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b5473c0 going to sleep for 6 seconds 00000100:00100000:0.0:1715205775.627116:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800910eb900 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456029248:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205775.627129:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006f64 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205775.627232:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.627296:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455752640 00010000:00010000:0.0:1715205775.627308:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006f4f lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2353e expref: 144 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.627338:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4679 00000100:00100000:0.0:1715205775.627342:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4417c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+144:1831:x1798520455752640:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205775.627349:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.627352:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006f4f lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2353e expref: 144 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.627358:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006f4f lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2353e expref: 144 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.627369:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305006f4f lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2353e expref: 144 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.627382:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee9:0x0].0x0 (ffff88009399e100) 00010000:00010000:0.0:1715205775.627385:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006f64 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.627390:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006f64 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.627399:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006f64 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.627411:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205775.627440:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4417c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+143:1831:x1798520455752640:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 97us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.627445:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4679 00010000:00010000:2.0:1715205775.627499:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006f64 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.627505:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006f64 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205775.627530:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee9:0x0]: returning size 260096 00000004:00200000:2.0:1715205775.627533:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205775.627544:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006f64 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.627555:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006f64 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.627571:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305006f5d lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23545 expref: 143 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.627587:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006f64 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23545 expref: 142 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.627593:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee9:0x0].0x0 (ffff88009399e100) 00010000:00010000:2.0:1715205775.627594:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205775.627596:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c06c0, rc 0) 00010000:00000080:2.0:1715205775.627599:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d442140 x1798520455752576/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.627648:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d442140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+142:11754:x1798520455752576:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1481us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.627653:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1794 00000100:00100000:2.0:1715205775.628947:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.628996:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455752704 00000100:00100000:0.0:1715205775.629039:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1795 00000100:00100000:0.0:1715205775.629044:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d445580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+142:11754:x1798520455752704:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.629060:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.629077:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af4305006f6b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2354c expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629124:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af4305006f72 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629137:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af4305006f72 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629146:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af4305006f72 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629159:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305006f79 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xa1380d88 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629165:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305006f79 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629175:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305006f79 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629397:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305006f80 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629404:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305006f80 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629410:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305006f80 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205775.629429:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeea:0x0]: returning size 260096 00000004:00200000:0.0:1715205775.629433:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205775.629445:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305006f80 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629452:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305006f80 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629458:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af4305006f72 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629463:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af4305006f72 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629469:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af4305006f72 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629475:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c0900 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.629479:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af4305006f72 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629485:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af4305006f72 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629494:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205775.629496:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.629499:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af4305006f72 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629504:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af4305006f72 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629514:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305006f79 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629519:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305006f79 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629524:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305006f79 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629528:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c18c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.629530:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305006f79 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629535:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305006f79 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629541:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0xa1380d88 (ffff88012e817400) 00010000:00010000:0.0:1715205775.629543:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.629545:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305006f79 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629549:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305006f79 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629571:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af4305006f6b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2354c expref: 144 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629581:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305006f80 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2354c expref: 143 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.629586:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeea:0x0].0x0 (ffff88012e817a00) 00010000:00010000:0.0:1715205775.629588:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205775.629589:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c3cc0, rc 0) 00010000:00000080:0.0:1715205775.629593:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d445580 x1798520455752704/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.629673:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d445580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+143:11754:x1798520455752704:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 628us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.629680:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1795 00000100:00100000:1.0:1715205775.631004:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.631043:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455752832 00000100:00100000:0.0:1715205775.631079:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1796 00000100:00100000:0.0:1715205775.631084:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372fc280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+143:11754:x1798520455752832:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.631094:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.631103:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af4305006f87 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23553 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.631171:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006f8e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.631183:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305006f80 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2354c expref: 144 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.631189:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006f8e lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.631222:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305006f80 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2354c expref: 144 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.631233:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305006f80 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2354c expref: 144 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.631246:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800910eb900 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456029312:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205775.631307:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b547900 going to sleep for 6 seconds 00000100:00100000:0.0:1715205775.632061:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800910eb900 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456029312:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205775.632139:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006f8e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.632211:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.632236:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455752896 00010000:00010000:0.0:1715205775.632257:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305006f80 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2354c expref: 145 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.632275:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4680 00000100:00100000:0.0:1715205775.632279:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372f9300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+145:1831:x1798520455752896:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1715205775.632289:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.632293:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305006f80 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2354c expref: 145 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.632300:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305006f80 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2354c expref: 145 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.632316:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305006f80 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2354c expref: 145 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.632326:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeea:0x0].0x0 (ffff88012e817a00) 00010000:00010000:0.0:1715205775.632329:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006f8e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.632336:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006f8e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.632341:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006f8e lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.632372:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205775.632410:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006f8e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.632417:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372f9300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+144:1831:x1798520455752896:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 136us (207us total) trans 0 rc 0/0 00010000:00010000:2.0:1715205775.632417:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006f8e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.632423:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4680 00000004:00200000:2.0:1715205775.632432:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeea:0x0]: returning size 260096 00010000:00010000:2.0:1715205775.632559:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af4305006f87 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23553 expref: 145 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.632574:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006f8e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23553 expref: 144 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.632579:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeea:0x0].0x0 (ffff88012e817a00) 00010000:00010000:2.0:1715205775.632581:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205775.632582:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c2640, rc 0) 00010000:00000080:2.0:1715205775.632586:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801372fc280 x1798520455752832/t330712482578(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.632638:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372fc280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+144:11754:x1798520455752832:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1554us (1635us total) trans 330712482578 rc 0/0 00000100:00100000:2.0:1715205775.632644:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1796 00000100:00100000:1.0:1715205775.633953:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.634004:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455752960 00000100:00100000:2.0:1715205775.634041:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1797 00000100:00100000:2.0:1715205775.634046:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372f97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+144:11754:x1798520455752960:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.634063:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.634075:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8d80/0xb608af4305006f9c lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2355a expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.634119:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006fa3 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.634129:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006f8e lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23553 expref: 145 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.634134:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006fa3 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.634157:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006f8e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23553 expref: 145 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.634172:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006f8e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23553 expref: 145 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.634182:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d446880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456029376:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205775.634236:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a6ea03c0 going to sleep for 6 seconds 00000100:00100000:2.0:1715205775.634969:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d446880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456029376:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205775.634989:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006fa3 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.635327:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.635362:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455753024 00010000:00010000:0.0:1715205775.635381:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006f8e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23553 expref: 146 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.635415:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4681 00000100:00100000:0.0:1715205775.635419:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a7050850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+146:1830:x1798520455753024:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1715205775.635427:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.635431:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006f8e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23553 expref: 146 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.635439:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006f8e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23553 expref: 146 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.635454:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305006f8e lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23553 expref: 146 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.635466:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeea:0x0].0x0 (ffff88012e817a00) 00010000:00010000:0.0:1715205775.635468:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006fa3 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.635473:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006fa3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.635477:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006fa3 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.635495:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205775.635517:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006fa3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.635524:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006fa3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.635525:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a7050850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+145:1830:x1798520455753024:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 106us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.635531:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4681 00000004:00200000:2.0:1715205775.635559:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeea:0x0]: returning size 260096 00000004:00200000:2.0:1715205775.635562:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205775.635576:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006fa3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.635582:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006fa3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.635596:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8d80/0xb608af4305006f9c lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2355a expref: 145 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.635609:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006fa3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2355a expref: 144 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.635614:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeea:0x0].0x0 (ffff88012e817a00) 00010000:00010000:2.0:1715205775.635638:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205775.635640:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940c8b40, rc 0) 00010000:00000080:2.0:1715205775.635645:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801372f97c0 x1798520455752960/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.635677:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372f97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+144:11754:x1798520455752960:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1631us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.635683:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1797 00000100:00100000:1.0:1715205775.636659:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.636695:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455753088 00000100:00100000:2.0:1715205775.636714:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1798 00000100:00100000:2.0:1715205775.636718:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372fbdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+144:11754:x1798520455753088:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.636728:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.636737:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8000/0xb608af4305006faa lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23561 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.636781:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006fb1 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.636790:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006fb1 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.636797:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006fb1 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.636814:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006fb8 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x55390488 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.636820:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006fb8 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.636825:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006fb8 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.637018:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cbcc0/0xb608af4305006fbf lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.637022:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cbcc0/0xb608af4305006fbf lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.637026:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cbcc0/0xb608af4305006fbf lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205775.637035:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeeb:0x0]: returning size 260096 00000004:00200000:2.0:1715205775.637037:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205775.637042:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cbcc0/0xb608af4305006fbf lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.637046:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cbcc0/0xb608af4305006fbf lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.637051:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006fb1 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.637053:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006fb1 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.637058:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006fb1 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.637062:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940caac0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.637064:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006fb1 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.637067:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006fb1 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.637071:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205775.637073:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.637074:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006fb1 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.637076:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305006fb1 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.637081:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006fb8 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.637084:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006fb8 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.637087:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006fb8 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.637089:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940cad00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.637090:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006fb8 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.637093:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006fb8 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.637096:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x55390488 (ffff88008f367d00) 00010000:00010000:2.0:1715205775.637097:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.637098:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006fb8 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.637100:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af4305006fb8 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.637112:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8000/0xb608af4305006faa lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23561 expref: 146 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.637116:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cbcc0/0xb608af4305006fbf lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23561 expref: 145 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.637118:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeeb:0x0].0x0 (ffff88008f367f00) 00010000:00010000:2.0:1715205775.637119:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205775.637120:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940cbcc0, rc 0) 00010000:00000080:2.0:1715205775.637122:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801372fbdc0 x1798520455753088/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.637153:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372fbdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+145:11754:x1798520455753088:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 435us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.637157:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1798 00000100:00100000:1.0:1715205775.638285:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.638366:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455753216 00000100:00100000:2.0:1715205775.638415:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1799 00000100:00100000:2.0:1715205775.638421:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372fd0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+145:11754:x1798520455753216:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.638436:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.638451:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006fc6 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23568 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.638534:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006fcd lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.638556:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cbcc0/0xb608af4305006fbf lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23561 expref: 146 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.638561:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006fcd lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.638606:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cbcc0/0xb608af4305006fbf lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23561 expref: 146 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.638615:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cbcc0/0xb608af4305006fbf lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23561 expref: 146 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.638662:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d446880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456029440:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205775.638714:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a6ea09c0 going to sleep for 6 seconds 00000100:00100000:2.0:1715205775.639584:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d446880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456029440:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205775.639604:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006fcd lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.639795:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.639865:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455753280 00010000:00010000:0.0:1715205775.639882:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cbcc0/0xb608af4305006fbf lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23561 expref: 147 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.639917:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4682 00000100:00100000:0.0:1715205775.639921:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372fd580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+147:1831:x1798520455753280:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1715205775.639930:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.639933:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cbcc0/0xb608af4305006fbf lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23561 expref: 147 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.639942:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cbcc0/0xb608af4305006fbf lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23561 expref: 147 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.639956:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cbcc0/0xb608af4305006fbf lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23561 expref: 147 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.639967:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeeb:0x0].0x0 (ffff88008f367f00) 00010000:00010000:0.0:1715205775.639970:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006fcd lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.639976:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006fcd lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.639981:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006fcd lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.640004:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205775.640023:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006fcd lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.640027:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372fd580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+146:1831:x1798520455753280:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 105us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.640034:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4682 00010000:00010000:2.0:1715205775.640034:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006fcd lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205775.640049:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeeb:0x0]: returning size 260096 00010000:00010000:2.0:1715205775.640170:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af4305006fc6 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23568 expref: 147 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.640179:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006fcd lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23568 expref: 146 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.640184:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeeb:0x0].0x0 (ffff88008f367f00) 00010000:00010000:2.0:1715205775.640185:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205775.640186:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940c8240, rc 0) 00010000:00000080:2.0:1715205775.640190:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801372fd0c0 x1798520455753216/t330712482579(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.640223:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372fd0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+146:11754:x1798520455753216:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1803us (1943us total) trans 330712482579 rc 0/0 00000100:00100000:2.0:1715205775.640227:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1799 00000100:00100000:1.0:1715205775.641179:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.641230:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455753344 00000100:00100000:2.0:1715205775.641267:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1800 00000100:00100000:2.0:1715205775.641272:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372fdf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+146:11754:x1798520455753344:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.641285:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.641295:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006fdb lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2356f expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.641333:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006fe2 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.641342:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006fcd lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23568 expref: 147 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.641348:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006fe2 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.641374:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006fcd lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23568 expref: 147 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.641383:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006fcd lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23568 expref: 147 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.641393:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d446880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456029504:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205775.641434:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a6ea09c0 going to sleep for 6 seconds 00000100:00100000:2.0:1715205775.643213:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d446880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456029504:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205775.643236:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006fe2 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.643294:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.643371:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455753408 00010000:00010000:0.0:1715205775.643397:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006fcd lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23568 expref: 148 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.643417:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4683 00000100:00100000:0.0:1715205775.643422:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372fed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+148:1831:x1798520455753408:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205775.643433:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.643436:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006fcd lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23568 expref: 148 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.643444:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006fcd lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23568 expref: 148 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.643460:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305006fcd lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23568 expref: 148 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.643471:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeeb:0x0].0x0 (ffff88008f367f00) 00010000:00010000:0.0:1715205775.643473:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006fe2 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.643481:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006fe2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.643487:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006fe2 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.643562:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205775.643562:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006fe2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.643568:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006fe2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205775.643602:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeeb:0x0]: returning size 260096 00000004:00200000:2.0:1715205775.643606:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:0.0:1715205775.643610:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372fed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+147:1831:x1798520455753408:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 187us (317us total) trans 0 rc 0/0 00000004:00010000:2.0:1715205775.643644:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006fe2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.643650:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4683 00010000:00010000:2.0:1715205775.643653:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006fe2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.643673:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af4305006fdb lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2356f expref: 147 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.643684:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006fe2 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2356f expref: 146 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.643690:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeeb:0x0].0x0 (ffff88008f367f00) 00010000:00010000:2.0:1715205775.643692:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205775.643693:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940c98c0, rc 0) 00010000:00000080:2.0:1715205775.643698:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801372fdf00 x1798520455753344/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.643727:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372fdf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+146:11754:x1798520455753344:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2455us (2549us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.643733:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1800 00000100:00100000:3.0:1715205775.645484:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.645566:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455753472 00000100:00100000:2.0:1715205775.645611:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1801 00000100:00100000:2.0:1715205775.645616:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1771c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+146:11754:x1798520455753472:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.645655:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.645668:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305006fe9 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23576 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.645709:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006ff0 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.645728:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006ff0 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.645736:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006ff0 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.645757:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af4305006ff7 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x2f856f5d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.645763:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af4305006ff7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.645768:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af4305006ff7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.645928:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af4305006ffe lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.645934:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af4305006ffe lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.645939:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af4305006ffe lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205775.645956:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeec:0x0]: returning size 260096 00000004:00200000:2.0:1715205775.645959:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205775.645969:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af4305006ffe lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.645976:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af4305006ffe lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.645982:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006ff0 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.645986:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006ff0 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.645990:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006ff0 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.645995:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940ca640 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.645997:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006ff0 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.646002:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006ff0 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.646010:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205775.646012:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.646014:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006ff0 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.646018:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305006ff0 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.646026:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af4305006ff7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.646030:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af4305006ff7 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.646038:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af4305006ff7 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.646042:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940ca880 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.646043:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af4305006ff7 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.646047:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af4305006ff7 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.646052:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x2f856f5d (ffff88008f367100) 00010000:00010000:2.0:1715205775.646053:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.646054:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af4305006ff7 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.646058:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af4305006ff7 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.646077:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305006fe9 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23576 expref: 148 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.646087:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af4305006ffe lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23576 expref: 147 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.646092:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:2.0:1715205775.646094:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205775.646095:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940c9d40, rc 0) 00010000:00000080:2.0:1715205775.646098:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1771c80 x1798520455753472/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.646146:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1771c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+147:11754:x1798520455753472:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 530us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.646152:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1801 00000100:00100000:1.0:1715205775.647426:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.647480:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455753600 00000100:00100000:0.0:1715205775.647531:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1802 00000100:00100000:0.0:1715205775.647536:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372fc740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+147:11754:x1798520455753600:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.647553:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.647572:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305007005 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2357d expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.647673:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af430500700c lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.647686:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af4305006ffe lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23576 expref: 148 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.647692:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af430500700c lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.647727:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af4305006ffe lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23576 expref: 148 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.647738:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af4305006ffe lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23576 expref: 148 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.647764:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800910e8980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456029568:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205775.647831:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b547cc0 going to sleep for 6 seconds 00000100:00100000:0.0:1715205775.648832:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800910e8980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456029568:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205775.648850:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af430500700c lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.648907:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.649037:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455753664 00010000:00010000:0.0:1715205775.649052:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af4305006ffe lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23576 expref: 149 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.649076:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4684 00000100:00100000:0.0:1715205775.649079:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372faf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+149:1830:x1798520455753664:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1715205775.649086:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.649088:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af4305006ffe lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23576 expref: 149 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.649094:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af4305006ffe lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23576 expref: 149 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.649105:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af4305006ffe lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23576 expref: 149 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.649114:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:0.0:1715205775.649117:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af430500700c lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.649121:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af430500700c lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.649125:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af430500700c lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.649140:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205775.649158:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372faf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+148:1830:x1798520455753664:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 78us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.649163:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4684 00010000:00010000:2.0:1715205775.649163:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af430500700c lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.649171:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af430500700c lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205775.649185:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeec:0x0]: returning size 260096 00010000:00010000:2.0:1715205775.649374:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305007005 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2357d expref: 149 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.649386:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af430500700c lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2357d expref: 148 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.649391:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:2.0:1715205775.649393:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205775.649395:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c0480, rc 0) 00010000:00000080:2.0:1715205775.649399:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801372fc740 x1798520455753600/t330712482580(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.649434:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372fc740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+148:11754:x1798520455753600:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1897us (2011us total) trans 330712482580 rc 0/0 00000100:00100000:2.0:1715205775.649440:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1802 00000100:00100000:1.0:1715205775.650783:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.650879:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455753728 00000100:00100000:2.0:1715205775.650935:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1803 00000100:00100000:2.0:1715205775.650940:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372fb900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+148:11754:x1798520455753728:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.650959:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.650975:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af430500701a lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23584 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.651032:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305007021 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.651045:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af430500700c lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2357d expref: 149 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.651051:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305007021 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.651076:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af430500700c lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2357d expref: 149 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.651085:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af430500700c lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2357d expref: 149 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.651094:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d446880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456029632:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205775.651153:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a6ea0180 going to sleep for 6 seconds 00000100:00100000:2.0:1715205775.652660:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d446880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456029632:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205775.652673:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:2.0:1715205775.652688:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305007021 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.652744:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455753792 00010000:00010000:1.0:1715205775.652772:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af430500700c lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2357d expref: 150 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.652805:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4685 00000100:00100000:1.0:1715205775.652809:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1773dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+150:1831:x1798520455753792:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1715205775.652818:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.652822:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af430500700c lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2357d expref: 150 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.652830:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af430500700c lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2357d expref: 150 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.652843:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af430500700c lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2357d expref: 150 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.652867:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:1.0:1715205775.652871:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305007021 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.652878:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305007021 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.652884:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305007021 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.652917:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205775.652952:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1773dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+149:1831:x1798520455753792:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 143us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.652958:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4685 00010000:00010000:3.0:1715205775.653016:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305007021 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.653022:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305007021 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205775.653050:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeec:0x0]: returning size 260096 00000004:00200000:3.0:1715205775.653054:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205775.653065:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305007021 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.653072:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305007021 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.653088:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af430500701a lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23584 expref: 149 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.653101:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305007021 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23584 expref: 148 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.653110:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:3.0:1715205775.653113:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205775.653114:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940cb840, rc 0) 00010000:00000080:3.0:1715205775.653118:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801372fb900 x1798520455753728/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.653151:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372fb900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+148:11754:x1798520455753728:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2212us (2372us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.653158:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1803 00000100:00100000:3.0:1715205775.654795:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.654884:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455753856 00000100:00100000:0.0:1715205775.654930:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1804 00000100:00100000:0.0:1715205775.654935:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1775580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+148:11754:x1798520455753856:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.654951:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.654965:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305007028 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2358b expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655010:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af430500702f lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655021:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af430500702f lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655030:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af430500702f lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655042:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305007036 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x9b856f73 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655047:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305007036 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655051:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305007036 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655270:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af430500703d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655277:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af430500703d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655283:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af430500703d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205775.655301:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeed:0x0]: returning size 260096 00000004:00200000:0.0:1715205775.655304:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205775.655316:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af430500703d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655323:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af430500703d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655329:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af430500702f lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655335:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af430500702f lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655340:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af430500702f lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655345:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c0000 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.655348:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af430500702f lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655353:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af430500702f lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655367:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205775.655369:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.655372:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af430500702f lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655377:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af430500702f lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655387:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305007036 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655397:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305007036 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655401:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305007036 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655406:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c18c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.655408:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305007036 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655412:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305007036 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655418:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x9b856f73 (ffff880092452c00) 00010000:00010000:0.0:1715205775.655419:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.655421:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305007036 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655433:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af4305007036 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655456:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305007028 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2358b expref: 150 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655464:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af430500703d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2358b expref: 149 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.655469:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeed:0x0].0x0 (ffff880092452f00) 00010000:00010000:0.0:1715205775.655471:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205775.655472:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c0900, rc 0) 00010000:00000080:0.0:1715205775.655476:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1775580 x1798520455753856/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.655527:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1775580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+149:11754:x1798520455753856:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 590us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.655533:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1804 00000100:00100000:0.0:1715205775.657105:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.657175:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455753984 00000100:00100000:2.0:1715205775.657556:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1805 00000100:00100000:2.0:1715205775.657562:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910e8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+149:11754:x1798520455753984:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.657579:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.657594:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8900/0xb608af4305007044 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23592 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.657695:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af430500704b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.657709:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af430500703d lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2358b expref: 150 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.657715:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af430500704b lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.657744:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af430500703d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2358b expref: 150 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.657766:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af430500703d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2358b expref: 150 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.657775:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d446880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456029696:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205775.657841:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a6ea0180 going to sleep for 6 seconds 00000100:00100000:0.0:1715205775.660161:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d446880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456029696:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205775.660183:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af430500704b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205775.660523:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.660572:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455754048 00010000:00010000:1.0:1715205775.660594:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af430500703d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2358b expref: 151 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.660639:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4686 00000100:00100000:1.0:1715205775.660643:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d440e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:1831:x1798520455754048:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1715205775.660652:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.660657:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af430500703d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2358b expref: 151 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.660664:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af430500703d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2358b expref: 151 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.660679:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af430500703d lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2358b expref: 151 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.660701:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeed:0x0].0x0 (ffff880092452f00) 00010000:00010000:1.0:1715205775.660704:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af430500704b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.660714:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af430500704b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.660719:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af430500704b lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.660732:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205775.660742:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af430500704b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.660761:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af430500704b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205775.660776:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeed:0x0]: returning size 260096 00000100:00100000:1.0:1715205775.660785:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d440e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+150:1831:x1798520455754048:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 141us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.660791:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4686 00010000:00010000:0.0:1715205775.660971:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8900/0xb608af4305007044 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23592 expref: 151 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.660981:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af430500704b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23592 expref: 150 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.660986:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeed:0x0].0x0 (ffff880092452f00) 00010000:00010000:0.0:1715205775.660988:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205775.660990:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940c8fc0, rc 0) 00010000:00000080:0.0:1715205775.660993:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910e8980 x1798520455753984/t330712482581(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.661028:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910e8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+150:11754:x1798520455753984:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 3466us (3926us total) trans 330712482581 rc 0/0 00000100:00100000:0.0:1715205775.661033:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1805 00000100:00100000:2.0:1715205775.663022:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.663056:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455754112 00000100:00100000:0.0:1715205775.663082:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1806 00000100:00100000:0.0:1715205775.663086:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d445a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+150:11754:x1798520455754112:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.663097:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.663107:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305007059 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23599 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.663136:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305007060 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.663143:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af430500704b lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23592 expref: 151 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.663147:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305007060 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.663163:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af430500704b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23592 expref: 151 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.663169:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af430500704b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23592 expref: 151 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.663176:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800910eb900 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456029760:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205775.663212:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b5476c0 going to sleep for 6 seconds 00000100:00100000:0.0:1715205775.664740:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800910eb900 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456029760:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205775.664836:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305007060 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205775.664884:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.665003:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455754176 00010000:00010000:1.0:1715205775.665020:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af430500704b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23592 expref: 152 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.665041:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4687 00000100:00100000:1.0:1715205775.665044:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d440980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+152:1830:x1798520455754176:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1715205775.665050:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.665053:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af430500704b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23592 expref: 152 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.665058:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af430500704b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23592 expref: 152 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.665068:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af430500704b lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23592 expref: 152 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.665075:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeed:0x0].0x0 (ffff880092452f00) 00010000:00010000:1.0:1715205775.665078:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305007060 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.665082:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305007060 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.665085:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305007060 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.665095:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205775.665103:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305007060 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.665110:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305007060 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.665119:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d440980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:1830:x1798520455754176:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 74us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.665125:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4687 00000004:00200000:0.0:1715205775.665139:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeed:0x0]: returning size 260096 00000004:00200000:0.0:1715205775.665142:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205775.665153:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305007060 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.665160:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305007060 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.665176:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305007059 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23599 expref: 151 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.665185:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305007060 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23599 expref: 150 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.665190:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeed:0x0].0x0 (ffff880092452f00) 00010000:00010000:0.0:1715205775.665192:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205775.665194:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c3600, rc 0) 00010000:00000080:0.0:1715205775.665198:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d445a40 x1798520455754112/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.665227:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d445a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+150:11754:x1798520455754112:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2140us (2207us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.665241:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1806 00000100:00100000:2.0:1715205775.666767:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.666823:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455754240 00000100:00100000:0.0:1715205775.666844:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1807 00000100:00100000:0.0:1715205775.666848:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d444740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+150:11754:x1798520455754240:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.666858:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.666867:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305007067 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b235a0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.666900:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af430500706e lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.666908:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af430500706e lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.666918:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af430500706e lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.666928:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305007075 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xe385a24b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.666932:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305007075 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.666937:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305007075 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.667099:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af430500707c lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.667106:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af430500707c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.667111:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af430500707c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205775.667123:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeee:0x0]: returning size 260096 00000004:00200000:0.0:1715205775.667126:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205775.667134:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af430500707c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.667140:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af430500707c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.667144:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af430500706e lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.667149:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af430500706e lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.667154:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af430500706e lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.667158:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c1f80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.667161:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af430500706e lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.667166:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af430500706e lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.667173:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205775.667174:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.667176:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af430500706e lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.667181:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af430500706e lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.667188:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305007075 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.667192:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305007075 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.667196:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305007075 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.667204:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c1200 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.667205:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305007075 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.667209:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305007075 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.667213:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0xe385a24b (ffff8800b410fe00) 00010000:00010000:0.0:1715205775.667215:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.667216:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305007075 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.667220:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af4305007075 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.667236:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305007067 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235a0 expref: 152 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.667244:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af430500707c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235a0 expref: 151 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.667248:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeee:0x0].0x0 (ffff8800b410f900) 00010000:00010000:0.0:1715205775.667250:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205775.667251:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c2640, rc 0) 00010000:00000080:0.0:1715205775.667254:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d444740 x1798520455754240/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.667294:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d444740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:11754:x1798520455754240:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 445us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.667300:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1807 00000100:00100000:2.0:1715205775.669174:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.669269:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455754368 00000100:00100000:0.0:1715205775.669311:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1808 00000100:00100000:0.0:1715205775.669316:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d443900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:11754:x1798520455754368:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.669327:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.669348:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305007083 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b235a7 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.669400:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500708a lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.669409:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af430500707c lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235a0 expref: 152 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.669415:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500708a lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.669439:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af430500707c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235a0 expref: 152 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.669448:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af430500707c lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235a0 expref: 152 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.669458:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800910eb900 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456029824:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205775.669519:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b547300 going to sleep for 6 seconds 00000100:00100000:0.0:1715205775.670584:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800910eb900 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456029824:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205775.670607:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500708a lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205775.670698:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.670782:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455754432 00010000:00010000:1.0:1715205775.670799:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af430500707c lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235a0 expref: 153 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.670819:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4688 00000100:00100000:1.0:1715205775.670825:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b521c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:1831:x1798520455754432:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1715205775.670831:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205775.670834:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af430500707c lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235a0 expref: 153 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.670840:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af430500707c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235a0 expref: 153 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.670851:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af430500707c lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235a0 expref: 153 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205775.670936:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeee:0x0].0x0 (ffff8800b410f900) 00010000:00010000:1.0:1715205775.670939:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500708a lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.670945:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500708a lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.670950:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500708a lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.671000:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205775.671029:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b521c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+152:1831:x1798520455754432:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 206us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.671034:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4688 00010000:00010000:0.0:1715205775.671101:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500708a lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.671108:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500708a lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205775.671120:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeee:0x0]: returning size 260096 00010000:00010000:0.0:1715205775.671216:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305007083 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235a7 expref: 153 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.671227:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500708a lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235a7 expref: 152 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.671233:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeee:0x0].0x0 (ffff8800b410f900) 00010000:00010000:0.0:1715205775.671235:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205775.671236:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c18c0, rc 0) 00010000:00000080:0.0:1715205775.671240:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d443900 x1798520455754368/t330712482582(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.671260:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d443900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+152:11754:x1798520455754368:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1944us (2092us total) trans 330712482582 rc 0/0 00000100:00100000:0.0:1715205775.671266:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1808 00000100:00100000:3.0:1715205775.672263:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.672287:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455754496 00000100:00100000:0.0:1715205775.672320:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1809 00000100:00100000:0.0:1715205775.672324:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1772600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+152:11754:x1798520455754496:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.672342:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.672353:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305007098 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b235ae expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.672389:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af430500709f lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.672398:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500708a lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235a7 expref: 153 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.672404:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af430500709f lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.672428:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500708a lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235a7 expref: 153 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.672437:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500708a lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235a7 expref: 153 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.672448:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800910eb900 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456029888:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205775.672498:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b547300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205775.673887:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.673934:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455754560 00010000:00010000:0.0:1715205775.673957:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500708a lrc: 5/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235a7 expref: 154 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.673980:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4689 00000100:00100000:0.0:1715205775.673984:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d440e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+154:1830:x1798520455754560:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1715205775.673992:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.673996:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500708a lrc: 5/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235a7 expref: 154 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.674009:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500708a lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235a7 expref: 154 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.674025:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeee:0x0].0x0 (ffff8800b410f900) 00010000:00010000:0.0:1715205775.674028:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af430500709f lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.674034:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af430500709f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.674039:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af430500709f lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.674053:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205775.674091:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d440e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+154:1830:x1798520455754560:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 106us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.674097:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4689 00010000:00010000:1.0:1715205775.674197:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500708a lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235a7 expref: 153 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.674213:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800910eb900 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456029888:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205775.674229:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af430500709f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.674236:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af430500709f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.674240:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af430500709f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205775.674269:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeee:0x0]: returning size 260096 00000004:00200000:1.0:1715205775.674272:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205775.674285:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af430500709f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.674293:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af430500709f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.674312:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305007098 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235ae expref: 153 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.674321:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af430500709f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235ae expref: 152 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.674327:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeee:0x0].0x0 (ffff8800b410f900) 00010000:00010000:1.0:1715205775.674329:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205775.674330:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c1200, rc 0) 00010000:00000080:1.0:1715205775.674334:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1772600 x1798520455754496/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.674379:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1772600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+152:11754:x1798520455754496:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2054us (2117us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.674386:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1809 00000100:00100000:2.0:1715205775.675907:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.675956:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455754624 00000100:00100000:1.0:1715205775.675991:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1810 00000100:00100000:1.0:1715205775.675995:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d440980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+152:11754:x1798520455754624:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.676008:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.676020:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170000/0xb608af43050070a6 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b235b5 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676053:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af43050070ad lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676062:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af43050070ad lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676069:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af43050070ad lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676079:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af43050070b4 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xec85a24b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676083:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af43050070b4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676088:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af43050070b4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676246:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af43050070bb lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676253:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af43050070bb lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676258:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af43050070bb lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205775.676271:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeef:0x0]: returning size 260096 00000004:00200000:1.0:1715205775.676273:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205775.676281:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af43050070bb lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676287:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af43050070bb lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676292:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af43050070ad lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676296:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af43050070ad lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676301:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af43050070ad lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676306:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099170fc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.676308:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af43050070ad lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676312:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af43050070ad lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676319:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.676321:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.676324:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af43050070ad lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676327:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af43050070ad lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676335:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af43050070b4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676339:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af43050070b4 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676347:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af43050070b4 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676350:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099170480 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.676351:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af43050070b4 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676355:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af43050070b4 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676359:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0xec85a24b (ffff880129f26300) 00010000:00010000:1.0:1715205775.676360:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.676361:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af43050070b4 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676365:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af43050070b4 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676382:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170000/0xb608af43050070a6 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235b5 expref: 154 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676389:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af43050070bb lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235b5 expref: 153 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.676393:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeef:0x0].0x0 (ffff880129f26800) 00010000:00010000:1.0:1715205775.676395:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205775.676396:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099172f40, rc 0) 00010000:00000080:1.0:1715205775.676399:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d440980 x1798520455754624/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.676444:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d440980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:11754:x1798520455754624:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 448us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.676449:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1810 00000100:00100000:3.0:1715205775.677810:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.677851:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455754752 00000100:00100000:1.0:1715205775.677880:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1811 00000100:00100000:1.0:1715205775.677883:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a17704c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:11754:x1798520455754752:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.677893:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.677902:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050070c2 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b235bc expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.677947:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af43050070c9 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.677955:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af43050070bb lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235b5 expref: 154 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.677960:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af43050070c9 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.677992:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af43050070bb lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235b5 expref: 154 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.678001:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af43050070bb lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235b5 expref: 154 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.678010:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fd580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456029952:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.678045:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b4240 going to sleep for 6 seconds 00000100:00100000:3.0:1715205775.679229:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.679270:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455754816 00010000:00010000:2.0:1715205775.679284:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af43050070bb lrc: 5/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235b5 expref: 155 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.679294:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fd580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456029952:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205775.679309:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af43050070c9 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205775.679312:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4690 00000100:00100000:2.0:1715205775.679315:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1773440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+155:1831:x1798520455754816:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1715205775.679322:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205775.679325:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af43050070bb lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235b5 expref: 155 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.679332:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af43050070bb lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235b5 expref: 155 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.679400:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af43050070bb lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235b5 expref: 155 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.679412:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeef:0x0].0x0 (ffff880129f26800) 00010000:00010000:2.0:1715205775.679415:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af43050070c9 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.679420:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af43050070c9 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.679425:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af43050070c9 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.679444:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205775.679464:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af43050070c9 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.679470:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af43050070c9 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205775.679473:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1773440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+154:1831:x1798520455754816:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 156us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.679480:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4690 00000004:00200000:1.0:1715205775.679482:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeef:0x0]: returning size 260096 00010000:00010000:1.0:1715205775.679680:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050070c2 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235bc expref: 155 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.679689:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af43050070c9 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235bc expref: 154 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.679694:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeef:0x0].0x0 (ffff880129f26800) 00010000:00010000:1.0:1715205775.679696:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205775.679697:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099172640, rc 0) 00010000:00000080:1.0:1715205775.679700:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a17704c0 x1798520455754752/t330712482583(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.679763:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a17704c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+154:11754:x1798520455754752:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1879us (1955us total) trans 330712482583 rc 0/0 00000100:00100000:1.0:1715205775.679769:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1811 00000100:00100000:3.0:1715205775.680801:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.680921:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455754880 00000100:00100000:1.0:1715205775.680948:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1812 00000100:00100000:1.0:1715205775.680952:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1773dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+154:11754:x1798520455754880:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.680966:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.680974:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af43050070d7 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b235c3 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.681035:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af43050070de lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.681045:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af43050070c9 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235bc expref: 155 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.681054:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af43050070de lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.681073:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af43050070c9 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235bc expref: 155 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.681081:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af43050070c9 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235bc expref: 155 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.681089:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fd580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456030016:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.681192:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b4240 going to sleep for 6 seconds 00000100:00100000:2.0:1715205775.682526:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.682588:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fd580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456030016:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205775.682597:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455754944 00010000:00010000:1.0:1715205775.682600:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af43050070de lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.682645:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af43050070c9 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235bc expref: 156 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.682672:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4691 00000100:00100000:3.0:1715205775.682676:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d446880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:1830:x1798520455754944:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1715205775.682684:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.682688:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af43050070c9 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235bc expref: 156 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.682695:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af43050070c9 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235bc expref: 156 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.682711:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af43050070c9 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235bc expref: 156 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.682735:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeef:0x0].0x0 (ffff880129f26800) 00010000:00010000:3.0:1715205775.682738:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af43050070de lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.682744:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af43050070de lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.682761:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af43050070de lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.682781:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205775.682807:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af43050070de lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.682820:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af43050070de lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205775.682862:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeef:0x0]: returning size 260096 00000004:00200000:0.0:1715205775.682866:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205775.682882:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af43050070de lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.682892:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af43050070de lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.682916:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af43050070d7 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235c3 expref: 156 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.682942:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af43050070de lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235c3 expref: 155 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.682949:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeef:0x0].0x0 (ffff880129f26800) 00010000:00010000:0.0:1715205775.682951:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205775.682953:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099173a80, rc 0) 00010000:00000080:0.0:1715205775.682958:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1773dc0 x1798520455754880/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.683031:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d446880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+155:1830:x1798520455754944:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 353us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.683032:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1773dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+155:11754:x1798520455754880:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2077us (2231us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.683039:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4691 00000100:00100000:0.0:1715205775.683040:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1812 00000100:00100000:3.0:1715205775.684542:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.684653:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455755008 00000100:00100000:0.0:1715205775.684700:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1813 00000100:00100000:0.0:1715205775.684705:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1771300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+154:11754:x1798520455755008:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.684720:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.684733:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af43050070e5 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b235ca expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.684793:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af43050070ec lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.684803:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af43050070ec lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.684817:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af43050070ec lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.684829:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af43050070f3 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xd185bb5c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.684835:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af43050070f3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.684840:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af43050070f3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.685067:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050070fa lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.685074:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050070fa lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.685081:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050070fa lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205775.685099:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xef0:0x0]: returning size 260096 00000004:00200000:0.0:1715205775.685102:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205775.685112:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050070fa lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.685119:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050070fa lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.685126:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af43050070ec lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.685131:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af43050070ec lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.685136:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af43050070ec lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.685142:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c0b40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.685145:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af43050070ec lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.685151:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af43050070ec lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.685159:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205775.685160:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.685163:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af43050070ec lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.685167:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af43050070ec lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.685177:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af43050070f3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.685182:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af43050070f3 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.685185:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af43050070f3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.685193:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c0000 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.685195:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af43050070f3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.685199:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af43050070f3 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.685204:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0xd185bb5c (ffff880092452c00) 00010000:00010000:0.0:1715205775.685206:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.685207:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af43050070f3 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.685210:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af43050070f3 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.685231:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af43050070e5 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235ca expref: 156 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.685240:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050070fa lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235ca expref: 155 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.685245:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef0:0x0].0x0 (ffff88009c8aab00) 00010000:00010000:0.0:1715205775.685247:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205775.685248:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c0480, rc 0) 00010000:00000080:0.0:1715205775.685251:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1771300 x1798520455755008/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.685298:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1771300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+155:11754:x1798520455755008:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 594us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.685304:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1813 00000100:00100000:3.0:1715205775.686686:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.686834:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455755136 00000100:00100000:0.0:1715205775.686872:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1814 00000100:00100000:0.0:1715205775.686877:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1773900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+155:11754:x1798520455755136:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.686891:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.686902:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305007101 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b235d1 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.686978:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305007108 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.686990:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050070fa lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235ca expref: 156 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.686996:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305007108 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.687028:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050070fa lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235ca expref: 156 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.687040:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050070fa lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235ca expref: 156 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.687059:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800910ec740 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456030080:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205775.687118:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b547300 going to sleep for 6 seconds 00000100:00100000:0.0:1715205775.688193:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800910ec740 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456030080:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205775.688218:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305007108 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.688269:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.688331:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455755200 00010000:00010000:0.0:1715205775.688352:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050070fa lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235ca expref: 157 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.688379:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4692 00000100:00100000:0.0:1715205775.688383:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1772f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+157:1831:x1798520455755200:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1715205775.688391:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.688395:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050070fa lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235ca expref: 157 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.688401:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050070fa lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235ca expref: 157 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.688415:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af43050070fa lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235ca expref: 157 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.688425:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef0:0x0].0x0 (ffff88009c8aab00) 00010000:00010000:0.0:1715205775.688428:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305007108 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.688434:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305007108 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.688438:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305007108 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.688457:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205775.688493:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1772f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:1831:x1798520455755200:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 110us (225us total) trans 0 rc 0/0 00010000:00010000:1.0:1715205775.688496:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305007108 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.688498:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4692 00010000:00010000:1.0:1715205775.688505:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305007108 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205775.688521:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xef0:0x0]: returning size 260096 00010000:00010000:1.0:1715205775.688676:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af4305007101 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235d1 expref: 157 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.688685:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305007108 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235d1 expref: 156 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.688690:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef0:0x0].0x0 (ffff88009c8aab00) 00010000:00010000:1.0:1715205775.688691:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205775.688693:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c3cc0, rc 0) 00010000:00000080:1.0:1715205775.688697:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1773900 x1798520455755136/t330712482584(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.688730:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1773900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455755136:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1853us (2047us total) trans 330712482584 rc 0/0 00000100:00100000:1.0:1715205775.688735:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1814 00000100:00100000:3.0:1715205775.689659:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.689703:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455755264 00000100:00100000:1.0:1715205775.689738:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1815 00000100:00100000:1.0:1715205775.689743:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f8e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455755264:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.689771:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.689781:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007116 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b235d8 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.689822:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af430500711d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.689832:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305007108 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235d1 expref: 157 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.689838:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af430500711d lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.689861:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305007108 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235d1 expref: 157 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.689871:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305007108 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235d1 expref: 157 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.689881:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fd580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456030144:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.689924:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b4240 going to sleep for 6 seconds 00000100:00100000:1.0:1715205775.690845:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fd580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456030144:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205775.690859:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af430500711d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.691187:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.691264:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455755328 00010000:00010000:2.0:1715205775.691290:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305007108 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235d1 expref: 158 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.691331:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4693 00000100:00100000:2.0:1715205775.691335:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f84c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+158:1830:x1798520455755328:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1715205775.691344:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205775.691348:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305007108 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235d1 expref: 158 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.691356:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305007108 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235d1 expref: 158 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.691370:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af4305007108 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235d1 expref: 158 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.691394:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef0:0x0].0x0 (ffff88009c8aab00) 00010000:00010000:2.0:1715205775.691398:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af430500711d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.691404:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af430500711d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.691409:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af430500711d lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.691429:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205775.691434:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af430500711d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.691441:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af430500711d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205775.691466:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f84c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+157:1830:x1798520455755328:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 130us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.691472:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4693 00000004:00200000:1.0:1715205775.691473:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xef0:0x0]: returning size 260096 00000004:00200000:1.0:1715205775.691477:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205775.691490:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af430500711d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.691499:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af430500711d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.691518:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007116 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235d8 expref: 157 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.691533:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af430500711d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235d8 expref: 156 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.691539:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef0:0x0].0x0 (ffff88009c8aab00) 00010000:00010000:1.0:1715205775.691541:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205775.691543:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099172400, rc 0) 00010000:00000080:1.0:1715205775.691547:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6f8e40 x1798520455755264/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.691589:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f8e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455755264:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1845us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.691595:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1815 00000100:00100000:3.0:1715205775.693116:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.693173:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455755392 00000100:00100000:1.0:1715205775.693239:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1816 00000100:00100000:1.0:1715205775.693242:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6faf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455755392:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.693257:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.693266:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007124 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b235df expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.693300:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af430500712b lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.693310:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af430500712b lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.693321:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af430500712b lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.693333:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af4305007132 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.693339:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af4305007132 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.693344:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af4305007132 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.693418:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af430500712b lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.693424:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af430500712b lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.693432:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af430500712b lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.693438:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099171680 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.693441:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af430500712b lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.693446:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af430500712b lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.693452:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.693455:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.693458:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af430500712b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.693462:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af430500712b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.693473:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af4305007132 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.693478:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af4305007132 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.693480:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af4305007132 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.693482:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099170900 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.693483:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af4305007132 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.693486:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af4305007132 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.693489:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x522b8500 (ffff880129f26000) 00010000:00010000:1.0:1715205775.693490:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.693490:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af4305007132 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.693492:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af4305007132 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.693521:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007124 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235df expref: 157 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.693527:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007124 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235df expref: 157 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.693535:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099172d00, rc 0) 00010000:00000080:1.0:1715205775.693539:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6faf80 x1798520455755392/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.693580:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6faf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455755392:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 334us (462us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205775.693586:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1816 00000100:00100000:2.0:1715205775.694694:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.694784:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455755456 00000100:00100000:1.0:1715205775.694814:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1817 00000100:00100000:1.0:1715205775.694818:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455755456:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.694832:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.694845:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007139 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b235e6 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.694883:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305007140 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.694893:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305007140 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.694900:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305007140 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.694911:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009af258c0/0xb608af4305007147 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.694916:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009af258c0/0xb608af4305007147 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.694921:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009af258c0/0xb608af4305007147 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.694973:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305007140 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.694978:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305007140 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.694983:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305007140 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.694988:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099170d80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.694990:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305007140 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.694995:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305007140 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.695002:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.695004:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.695006:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305007140 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.695014:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305007140 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.695024:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009af258c0/0xb608af4305007147 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.695028:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009af258c0/0xb608af4305007147 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.695032:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009af258c0/0xb608af4305007147 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.695037:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009af258c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.695038:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009af258c0/0xb608af4305007147 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.695042:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009af258c0/0xb608af4305007147 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.695047:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x52788402 (ffff880129f26c00) 00010000:00010000:1.0:1715205775.695048:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.695049:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009af258c0/0xb608af4305007147 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.695053:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009af258c0/0xb608af4305007147 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.695079:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007139 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235e6 expref: 157 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.695089:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007139 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235e6 expref: 157 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.695097:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099172f40, rc 0) 00010000:00000080:1.0:1715205775.695100:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d440000 x1798520455755456/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.695152:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455755456:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 333us (462us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205775.695158:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1817 00000100:00100000:3.0:1715205775.696960:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.697389:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455755584 00000100:00100000:2.0:1715205775.697432:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1818 00000100:00100000:2.0:1715205775.697437:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455755584:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.697448:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.697460:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af430500714e lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b235ed expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.697524:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305007155 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.697534:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305007155 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.697541:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305007155 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.697551:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af430500715c lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.697556:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af430500715c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.697561:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af430500715c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.697589:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305007155 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.697594:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305007155 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.697599:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305007155 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.697603:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940c8480 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.697605:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305007155 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.697610:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305007155 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.697649:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205775.697651:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.697653:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305007155 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.697658:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af4305007155 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.697666:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af430500715c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.697670:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af430500715c lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.697678:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af430500715c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.697682:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940ca880 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.697684:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af430500715c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.697768:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af430500715c lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.697777:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x52788402 (ffff88008f367100) 00010000:00010000:2.0:1715205775.697779:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.697781:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af430500715c lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.697785:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af430500715c lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.697807:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af430500714e lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235ed expref: 157 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.697812:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af430500714e lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235ed expref: 157 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.697818:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940cb600, rc 0) 00010000:00000080:2.0:1715205775.697821:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6fda40 x1798520455755584/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 656/600 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.697860:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455755584:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 422us (903us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205775.697865:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1818 00000100:00100000:3.0:1715205775.698797:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.698849:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455755648 00000100:00100000:2.0:1715205775.699063:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1819 00000100:00100000:2.0:1715205775.699067:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fa140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455755648:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.699075:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.699081:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305007163 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b235f4 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.699103:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af430500716a lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.699110:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af430500716a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.699116:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af430500716a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.699124:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af4305007171 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.699128:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af4305007171 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.699132:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af4305007171 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.699158:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af430500716a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.699167:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af430500716a lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.699171:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af430500716a lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.699175:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940c9b00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.699176:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af430500716a lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.699180:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af430500716a lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.699185:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205775.699187:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.699188:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af430500716a lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.699192:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af430500716a lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.699199:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af4305007171 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.699203:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af4305007171 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.699207:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af4305007171 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.699215:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940c8fc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.699216:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af4305007171 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.699220:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af4305007171 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.699224:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x522b8500 (ffff88008f367d00) 00010000:00010000:2.0:1715205775.699226:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.699227:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af4305007171 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.699230:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af4305007171 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.699250:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305007163 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235f4 expref: 157 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.699255:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af4305007163 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235f4 expref: 157 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.699260:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940ca640, rc 0) 00010000:00000080:2.0:1715205775.699263:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6fa140 x1798520455755648/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.699285:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fa140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455755648:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 218us (491us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205775.699290:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1819 00000100:00100000:0.0:1715205775.700521:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.700615:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455755776 00000100:00100000:1.0:1715205775.700694:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1820 00000100:00100000:1.0:1715205775.700699:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ec740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455755776:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.700714:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.700728:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26400/0xb608af4305007178 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b235fb expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.700820:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26640/0xb608af430500717f lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.700831:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26640/0xb608af430500717f lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.700840:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26640/0xb608af430500717f lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.700851:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25b00/0xb608af4305007186 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.700867:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25b00/0xb608af4305007186 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.700872:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25b00/0xb608af4305007186 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.700903:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26640/0xb608af430500717f lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.700908:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26640/0xb608af430500717f lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.700914:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26640/0xb608af430500717f lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.700919:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009af26640 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.700927:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26640/0xb608af430500717f lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.700931:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26640/0xb608af430500717f lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.700940:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.700942:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.700945:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26640/0xb608af430500717f lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.700949:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26640/0xb608af430500717f lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.700963:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25b00/0xb608af4305007186 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.700968:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25b00/0xb608af4305007186 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.700972:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25b00/0xb608af4305007186 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.700976:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009af25b00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.700978:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25b00/0xb608af4305007186 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.700982:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25b00/0xb608af4305007186 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.700987:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x522b8500 (ffff880129f26b00) 00010000:00010000:1.0:1715205775.700989:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.700990:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25b00/0xb608af4305007186 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.700994:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25b00/0xb608af4305007186 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.701017:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26400/0xb608af4305007178 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235fb expref: 157 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.701023:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26400/0xb608af4305007178 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235fb expref: 157 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.701030:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009af26400, rc 0) 00010000:00000080:1.0:1715205775.701034:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910ec740 x1798520455755776/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 656/600 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.701084:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ec740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455755776:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 385us (568us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205775.701090:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1820 00000100:00100000:3.0:1715205775.702822:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.702907:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455755840 00000100:00100000:1.0:1715205775.702948:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1821 00000100:00100000:1.0:1715205775.702952:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455755840:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.702964:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.702975:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25680/0xb608af430500718d lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23602 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.703011:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009af24b40/0xb608af4305007194 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.703021:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009af24b40/0xb608af4305007194 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.703029:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009af24b40/0xb608af4305007194 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.703039:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26ac0/0xb608af430500719b lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.703045:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26ac0/0xb608af430500719b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.703054:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26ac0/0xb608af430500719b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.703101:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009af24b40/0xb608af4305007194 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.703107:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009af24b40/0xb608af4305007194 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.703112:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009af24b40/0xb608af4305007194 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.703117:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009af24b40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.703119:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009af24b40/0xb608af4305007194 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.703125:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009af24b40/0xb608af4305007194 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.703133:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.703135:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.703137:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009af24b40/0xb608af4305007194 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.703141:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009af24b40/0xb608af4305007194 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.703163:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26ac0/0xb608af430500719b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.703171:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26ac0/0xb608af430500719b lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.703175:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26ac0/0xb608af430500719b lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.703178:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009af26ac0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.703179:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26ac0/0xb608af430500719b lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.703184:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26ac0/0xb608af430500719b lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.703189:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x52788402 (ffff880129f26e00) 00010000:00010000:1.0:1715205775.703191:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.703192:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26ac0/0xb608af430500719b lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.703196:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26ac0/0xb608af430500719b lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.703237:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25680/0xb608af430500718d lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23602 expref: 157 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.703243:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25680/0xb608af430500718d lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23602 expref: 157 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.703250:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009af25680, rc 0) 00010000:00000080:1.0:1715205775.703255:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6f9300 x1798520455755840/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.703299:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455755840:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 347us (481us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205775.703305:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1821 00000100:00100000:3.0:1715205775.706168:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.706242:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455755968 00000100:00100000:1.0:1715205775.706275:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1822 00000100:00100000:1.0:1715205775.706279:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fa600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455755968:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.706292:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.706306:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009af27cc0/0xb608af43050071a2 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23609 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.706374:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009af24900/0xb608af43050071a9 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.706382:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009af24900/0xb608af43050071a9 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.706388:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009af24900/0xb608af43050071a9 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.706395:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25d40/0xb608af43050071b0 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.706398:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25d40/0xb608af43050071b0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.706401:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25d40/0xb608af43050071b0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.706428:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009af24900/0xb608af43050071a9 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.706433:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009af24900/0xb608af43050071a9 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.706437:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009af24900/0xb608af43050071a9 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.706442:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009af24900 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.706444:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009af24900/0xb608af43050071a9 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.706449:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009af24900/0xb608af43050071a9 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.706458:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.706460:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.706462:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009af24900/0xb608af43050071a9 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.706467:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009af24900/0xb608af43050071a9 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.706476:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25d40/0xb608af43050071b0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.706480:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25d40/0xb608af43050071b0 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.706488:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25d40/0xb608af43050071b0 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.706492:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009af25d40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.706494:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25d40/0xb608af43050071b0 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.706498:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25d40/0xb608af43050071b0 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.706504:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x52788402 (ffff880129f26a00) 00010000:00010000:1.0:1715205775.706505:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.706506:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25d40/0xb608af43050071b0 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.706510:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25d40/0xb608af43050071b0 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.706537:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009af27cc0/0xb608af43050071a2 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23609 expref: 157 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.706543:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009af27cc0/0xb608af43050071a2 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23609 expref: 157 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.706550:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009af27cc0, rc 0) 00010000:00000080:1.0:1715205775.706553:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6fa600 x1798520455755968/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 656/600 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.706594:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fa600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455755968:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 314us (432us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205775.706600:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1822 00000100:00100000:0.0:1715205775.707843:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.707881:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455756032 00000100:00100000:1.0:1715205775.707900:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1823 00000100:00100000:1.0:1715205775.707902:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910eaf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455756032:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.707908:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.707914:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009af261c0/0xb608af43050071b7 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23610 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.707931:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26f40/0xb608af43050071be lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.707936:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26f40/0xb608af43050071be lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.707940:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26f40/0xb608af43050071be lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.707945:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25200/0xb608af43050071c5 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.707948:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25200/0xb608af43050071c5 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.707951:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25200/0xb608af43050071c5 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.707970:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26f40/0xb608af43050071be lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.707975:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26f40/0xb608af43050071be lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.707978:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26f40/0xb608af43050071be lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.707980:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009af26f40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.707981:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26f40/0xb608af43050071be lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.707984:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26f40/0xb608af43050071be lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.707987:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.707988:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.707989:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26f40/0xb608af43050071be lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.707991:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26f40/0xb608af43050071be lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.707996:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25200/0xb608af43050071c5 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.707998:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25200/0xb608af43050071c5 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.708001:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25200/0xb608af43050071c5 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.708006:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009af25200 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.708007:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25200/0xb608af43050071c5 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.708009:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25200/0xb608af43050071c5 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.708011:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x522b8500 (ffff880129f26100) 00010000:00010000:1.0:1715205775.708012:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.708013:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25200/0xb608af43050071c5 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.708015:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25200/0xb608af43050071c5 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.708029:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009af261c0/0xb608af43050071b7 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23610 expref: 157 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.708032:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009af261c0/0xb608af43050071b7 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23610 expref: 157 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.708035:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009af261c0, rc 0) 00010000:00000080:1.0:1715205775.708037:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910eaf80 x1798520455756032/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.708062:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910eaf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455756032:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 158us (220us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205775.708065:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1823 00000100:00100000:3.0:1715205775.709339:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.709389:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455756160 00000100:00100000:1.0:1715205775.709416:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1824 00000100:00100000:1.0:1715205775.709420:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fc740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455756160:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.709428:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.709430:0:14185:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1715205775.709442:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cba80/0xb608af4305006db2 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234b2 expref: 156 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.709453:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.709455:0:14185:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205775.709461:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009af24000/0xb608af43050071cc lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23617 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.709527:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009af258c0/0xb608af43050071d3 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.709534:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009af258c0/0xb608af43050071d3 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.709540:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009af258c0/0xb608af43050071d3 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.709548:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050071da lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.709553:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050071da lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.709557:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050071da lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715205775.709918:0:14185:0:(osp_object.c:1645:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x100010000:0x15d9:0x0], index 1: 0 00010000:00010000:1.0:1715205775.710012:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af43050071e1 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.710017:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af43050071e1 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.710021:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af43050071e1 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.710035:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009af258c0/0xb608af43050071d3 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.710038:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009af258c0/0xb608af43050071d3 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.710040:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009af258c0/0xb608af43050071d3 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.710043:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009af258c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.710044:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009af258c0/0xb608af43050071d3 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.710047:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009af258c0/0xb608af43050071d3 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.710050:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.710051:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.710052:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009af258c0/0xb608af43050071d3 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.710055:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009af258c0/0xb608af43050071d3 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715205775.710060:0:14185:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88009e6fc740 reply state ffff88008f3d8000 transno 330712482585 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050071da lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.710071:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009af24000/0xb608af43050071cc lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23617 expref: 158 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.710079:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af43050071e1 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23617 expref: 157 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.710084:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1010:0x0].0x0 (ffff880129f26000) 00010000:00010000:1.0:1715205775.710086:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1715205775.710087:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd998c0, rc 0) 00010000:00000080:1.0:1715205775.710090:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6fc740 x1798520455756160/t330712482585(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 656/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.710129:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fc740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+158:11754:x1798520455756160:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 709us (792us total) trans 330712482585 rc 0/0 00000100:00100000:1.0:1715205775.710134:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1824 00000100:00100000:3.0:1715205775.711238:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.711275:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455756224 00000100:00100000:1.0:1715205775.711293:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1825 00000100:00100000:1.0:1715205775.711296:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fdf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+158:11754:x1798520455756224:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.711298:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050071da lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.711305:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.711306:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050071da lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.711311:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050071da lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.711312:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050071ef lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2361e expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.711315:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd9b840 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.711317:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050071da lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.711322:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050071da lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.711329:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x522b8500 (ffff880129f26c00) 00010000:00010000:2.0:1715205775.711331:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.711332:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050071da lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.711337:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050071f6 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.711337:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050071da lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.711348:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050071f6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.711354:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050071f6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205775.711369:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205775.711375:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050071f6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.711381:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050071f6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.711391:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050071ef lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2361e expref: 159 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.711398:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050071f6 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2361e expref: 158 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.711403:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1010:0x0].0x0 (ffff880129f26000) 00010000:00010000:1.0:1715205775.711404:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205775.711406:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9ad00, rc 0) 00010000:00000080:1.0:1715205775.711408:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6fdf00 x1798520455756224/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.711442:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fdf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+158:11754:x1798520455756224:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 145us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.711447:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1825 00000100:00100000:2.0:1715205775.712832:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.712862:0:19961:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455756288 00000100:00100000:0.0:1715205775.712884:0:19961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14683 00000100:00100000:0.0:1715205775.712887:0:19961:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4417c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+52:1830:x1798520455756288:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.712895:0:19961:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.712906:0:19961:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b8c3cc0/0xb608af43050071fd lrc: 2/0,0 mode: --/PR res: [0x15d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23625 expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1715205775.712921:0:19961:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x15d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1715205775.712932:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205775.712933:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205775.712939:0:19961:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8c3cc0/0xb608af43050071fd lrc: 3/0,0 mode: PR/PR res: [0x15d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23625 expref: 53 pid: 19961 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1715205775.712948:0:19961:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b8c3cc0/0xb608af43050071fd lrc: 3/0,0 mode: PR/PR res: [0x15d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23625 expref: 53 pid: 19961 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1715205775.712955:0:19961:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c3cc0, rc 0) 00000100:00100000:0.0:1715205775.712986:0:19961:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4417c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+53:1830:x1798520455756288:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 98us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.712991:0:19961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14683 00000100:00100000:3.0:1715205775.714053:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.714114:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455756416 00000100:00100000:2.0:1715205775.714146:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 474 00000100:00100000:2.0:1715205775.714150:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+158:11754:x1798520455756416:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205775.714330:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6f8980 x1798520455756416/t330712482586(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.714369:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+159:11754:x1798520455756416:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 218us (317us total) trans 330712482586 rc 0/0 00000100:00100000:2.0:1715205775.714374:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 474 00000100:00100000:3.0:1715205775.715409:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.715488:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455756544 00000100:00100000:1.0:1715205775.715508:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1826 00000100:00100000:1.0:1715205775.715511:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+159:11754:x1798520455756544:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.715522:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.715532:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af4305007204 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2362c expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.715582:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af430500720b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.715593:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050071f6 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2361e expref: 160 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.715599:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af430500720b lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.715647:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050071f6 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2361e expref: 160 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.715657:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050071f6 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2361e expref: 160 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.715666:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fd580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456030208:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.715708:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b4840 going to sleep for 6 seconds 00000100:00100000:1.0:1715205775.716756:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fd580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456030208:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205775.716757:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:1.0:1715205775.716770:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af430500720b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205775.716948:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455756608 00010000:00010000:2.0:1715205775.716964:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050071f6 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2361e expref: 161 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.716995:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4694 00000100:00100000:2.0:1715205775.716999:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fb900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+161:1831:x1798520455756608:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1715205775.717006:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205775.717009:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050071f6 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2361e expref: 161 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.717017:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050071f6 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2361e expref: 161 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.717030:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050071f6 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2361e expref: 161 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.717041:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1010:0x0].0x0 (ffff880129f26000) 00010000:00010000:2.0:1715205775.717043:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af430500720b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.717049:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af430500720b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.717054:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af430500720b lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.717078:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205775.717111:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fb900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+160:1831:x1798520455756608:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 111us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.717116:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4694 00010000:00010000:1.0:1715205775.717285:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af430500720b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.717291:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af430500720b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205775.717303:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1010:0x0]: returning size 0 00010000:00010000:1.0:1715205775.717388:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af4305007204 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2362c expref: 161 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.717402:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af430500720b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2362c expref: 160 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.717408:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1010:0x0].0x0 (ffff880129f26000) 00010000:00010000:1.0:1715205775.717409:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205775.717411:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9af40, rc 0) 00010000:00000080:1.0:1715205775.717414:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6fb440 x1798520455756544/t330712482587(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.717452:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+160:11754:x1798520455756544:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1940us (2045us total) trans 330712482587 rc 0/0 00000100:00100000:1.0:1715205775.717458:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1826 00000100:00100000:3.0:1715205775.718654:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.718735:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455756672 00000100:00100000:1.0:1715205775.718770:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1827 00000100:00100000:1.0:1715205775.718775:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+160:11754:x1798520455756672:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.718787:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.718797:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305007219 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23633 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.718832:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007220 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.718842:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af430500720b lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2362c expref: 161 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.718847:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007220 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.718866:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af430500720b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2362c expref: 161 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.718875:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af430500720b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2362c expref: 161 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.718883:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fd580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456030272:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.718927:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b4840 going to sleep for 6 seconds 00000100:00100000:1.0:1715205775.719801:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fd580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456030272:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205775.719816:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007220 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.719934:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.719986:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455756736 00010000:00010000:0.0:1715205775.720018:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af430500720b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2362c expref: 162 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.720061:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4695 00000100:00100000:0.0:1715205775.720066:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b521f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:1831:x1798520455756736:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205775.720078:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.720082:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af430500720b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2362c expref: 162 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.720091:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af430500720b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2362c expref: 162 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.720109:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af430500720b lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2362c expref: 162 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.720135:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1010:0x0].0x0 (ffff880129f26000) 00010000:00010000:0.0:1715205775.720139:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007220 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.720146:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007220 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.720153:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007220 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.720170:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205775.720211:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b521f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+161:1831:x1798520455756736:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 144us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.720217:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4695 00010000:00010000:1.0:1715205775.720334:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007220 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.720341:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007220 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205775.720369:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1010:0x0]: returning size 0 00000004:00200000:1.0:1715205775.720373:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205775.720383:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007220 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.720391:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007220 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.720408:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305007219 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23633 expref: 161 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.720419:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007220 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23633 expref: 160 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.720425:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1010:0x0].0x0 (ffff880129f26000) 00010000:00010000:1.0:1715205775.720427:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205775.720429:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd98d80, rc 0) 00010000:00000080:1.0:1715205775.720433:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6f97c0 x1798520455756672/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.720471:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+160:11754:x1798520455756672:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1695us (1854us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.720477:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1827 00000100:00100000:0.0:1715205775.721961:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.722067:0:19961:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455756800 00000100:00100000:1.0:1715205775.722105:0:19961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14684 00000100:00100000:1.0:1715205775.722109:0:19961:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+53:11754:x1798520455756800:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.722123:0:19961:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.722139:0:19961:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bd99d40/0xb608af4305007227 lrc: 2/0,0 mode: --/PW res: [0x15d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2363a expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.722188:0:19961:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b8c3cc0/0xb608af43050071fd lrc: 2/0,0 mode: PR/PR res: [0x15d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23625 expref: 54 pid: 19961 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1715205775.722196:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205775.722198:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205775.722200:0:19961:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bd99d40/0xb608af4305007227 lrc: 4/0,0 mode: --/PW res: [0x15d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2363a expref: 54 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.722228:0:19961:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b8c3cc0/0xb608af43050071fd lrc: 3/0,0 mode: PR/PR res: [0x15d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23625 expref: 54 pid: 19961 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1715205775.722239:0:19961:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b8c3cc0/0xb608af43050071fd lrc: 4/0,0 mode: PR/PR res: [0x15d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23625 expref: 54 pid: 19961 timeout: 3135 lvb_type: 1 00000100:00100000:1.0:1715205775.722250:0:19961:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fd580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:19961:1798520456030336:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.722303:0:19961:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b4840 going to sleep for 6 seconds 00000100:00100000:1.0:1715205775.723257:0:19961:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fd580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:19961:1798520456030336:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205775.723276:0:19961:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bd99d40/0xb608af4305007227 lrc: 3/0,0 mode: --/PW res: [0x15d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2363a expref: 54 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.723288:0:19961:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd99d40, rc 0) 00000100:00100000:1.0:1715205775.723321:0:19961:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+54:11754:x1798520455756800:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1211us (1362us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.723327:0:19961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14684 00000100:00100000:0.0:1715205775.723397:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.723607:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455756864 00010000:00010000:2.0:1715205775.723665:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b8c3cc0/0xb608af43050071fd lrc: 4/0,0 mode: PR/PR res: [0x15d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23625 expref: 54 pid: 19961 timeout: 3135 lvb_type: 1 00000100:00100000:2.0:1715205775.723700:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4696 00000100:00100000:2.0:1715205775.723705:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910e97c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+54:1831:x1798520455756864:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1715205775.723715:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205775.723731:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b8c3cc0/0xb608af43050071fd lrc: 4/0,0 mode: PR/PR res: [0x15d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23625 expref: 54 pid: 19961 timeout: 3135 lvb_type: 1 00010000:00010000:2.0:1715205775.723741:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b8c3cc0/0xb608af43050071fd lrc: 3/0,0 mode: PR/PR res: [0x15d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23625 expref: 54 pid: 19961 timeout: 3135 lvb_type: 1 00010000:00010000:2.0:1715205775.723793:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b8c3cc0/0xb608af43050071fd lrc: 0/0,0 mode: --/PR res: [0x15d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23625 expref: 54 pid: 19961 timeout: 3135 lvb_type: 1 00010000:00010000:2.0:1715205775.723805:0:6662:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715205775.723806:0:6662:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715205775.724447:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bd99d40/0xb608af4305007227 lrc: 2/0,0 mode: PW/PW res: [0x15d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2363a expref: 53 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.724456:0:6662:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bd99d40/0xb608af4305007227 lrc: 3/0,0 mode: PW/PW res: [0x15d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2363a expref: 53 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.724485:0:6662:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012bd99d40/0xb608af4305007227 lrc: 3/0,0 mode: PW/PW res: [0x15d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2363a expref: 53 pid: 19961 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205775.724495:0:6662:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d442600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6662:1798520456030400:192.168.204.8@tcp:105: 00000100:00100000:2.0:1715205775.724547:0:6662:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a6ea0540 going to sleep for 6 seconds 00000100:00100000:2.0:1715205775.725435:0:6662:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d442600 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6662:1798520456030400:192.168.204.8@tcp:105: 00010000:00010000:2.0:1715205775.725450:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205775.725480:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910e97c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+53:1831:x1798520455756864:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 1775us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.725487:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4696 00000100:00100000:0.0:1715205775.726094:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.726160:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455756992 00000100:00100000:2.0:1715205775.726183:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 475 00000100:00100000:2.0:1715205775.726187:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910e9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+160:11754:x1798520455756992:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205775.726382:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910e9c80 x1798520455756992/t330712482588(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.726415:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910e9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+161:11754:x1798520455756992:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 227us (321us total) trans 330712482588 rc 0/0 00000100:00100000:2.0:1715205775.726420:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 475 00000100:00100000:3.0:1715205775.727472:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.727559:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455757120 00000100:00100000:1.0:1715205775.727599:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1828 00000100:00100000:1.0:1715205775.727603:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+161:11754:x1798520455757120:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.727638:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.727653:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af430500722e lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23641 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.727734:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007235 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.727760:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007220 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23633 expref: 162 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.727765:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007235 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.727792:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007220 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23633 expref: 162 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.727802:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007220 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23633 expref: 162 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.727812:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fd580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456030464:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.727860:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b4840 going to sleep for 6 seconds 00000100:00100000:0.0:1715205775.728856:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fd580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456030464:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205775.728874:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007235 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.729075:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.729115:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455757184 00010000:00010000:2.0:1715205775.729131:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007220 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23633 expref: 163 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.729158:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4697 00000100:00100000:2.0:1715205775.729161:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+163:1831:x1798520455757184:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1715205775.729174:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205775.729178:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007220 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23633 expref: 163 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.729186:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007220 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23633 expref: 163 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.729201:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007220 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23633 expref: 163 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.729210:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1010:0x0].0x0 (ffff880129f26000) 00010000:00010000:2.0:1715205775.729212:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007235 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.729219:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007235 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.729223:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007235 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.729235:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205775.729240:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007235 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.729245:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007235 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205775.729258:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1010:0x0]: returning size 2048 00000100:00100000:2.0:1715205775.729267:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:1831:x1798520455757184:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 105us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.729271:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4697 00010000:00010000:0.0:1715205775.729349:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af430500722e lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23641 expref: 163 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.729372:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007235 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23641 expref: 162 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.729377:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1010:0x0].0x0 (ffff880129f26000) 00010000:00010000:0.0:1715205775.729378:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205775.729380:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd99200, rc 0) 00010000:00000080:0.0:1715205775.729383:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6fed40 x1798520455757120/t330712482589(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.729409:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:11754:x1798520455757120:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1805us (1938us total) trans 330712482589 rc 0/0 00000100:00100000:0.0:1715205775.729414:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1828 00000100:00100000:3.0:1715205775.730542:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.730573:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455757248 00000100:00100000:0.0:1715205775.730608:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1829 00000100:00100000:0.0:1715205775.730613:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:11754:x1798520455757248:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.730848:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.730860:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305007243 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23648 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.730901:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500724a lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.730912:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007235 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23641 expref: 163 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.730918:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500724a lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.730952:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007235 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23641 expref: 163 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.730963:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007235 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23641 expref: 163 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.730973:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800910ee3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456030528:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205775.731060:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134a1f300 going to sleep for 6 seconds 00000100:00100000:0.0:1715205775.732040:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800910ee3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456030528:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205775.732058:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500724a lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.732103:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.732188:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455757312 00010000:00010000:2.0:1715205775.732209:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007235 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23641 expref: 164 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.732241:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4698 00000100:00100000:2.0:1715205775.732246:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fd580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+164:1831:x1798520455757312:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1715205775.732257:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205775.732261:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007235 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23641 expref: 164 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.732269:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007235 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23641 expref: 164 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.732284:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007235 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23641 expref: 164 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.732294:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1010:0x0].0x0 (ffff880129f26000) 00010000:00010000:2.0:1715205775.732297:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500724a lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.732303:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500724a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.732309:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500724a lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.732345:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205775.732369:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fd580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+163:1831:x1798520455757312:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 123us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.732375:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4698 00010000:00010000:1.0:1715205775.732411:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500724a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.732417:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500724a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205775.732450:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1010:0x0]: returning size 2048 00000004:00200000:1.0:1715205775.732453:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205775.732465:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500724a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.732474:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500724a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.732492:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af4305007243 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23648 expref: 163 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.732515:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500724a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23648 expref: 162 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.732521:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1010:0x0].0x0 (ffff880129f26000) 00010000:00010000:1.0:1715205775.732523:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205775.732525:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c18c0, rc 0) 00010000:00000080:1.0:1715205775.732529:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6f9c80 x1798520455757248/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.732575:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:11754:x1798520455757248:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1962us (2034us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.732582:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1829 00000100:00100000:3.0:1715205775.734036:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.734096:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455757376 00000100:00100000:1.0:1715205775.734116:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1830 00000100:00100000:1.0:1715205775.734119:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6ff200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:11754:x1798520455757376:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.734130:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.734142:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af4305007251 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2364f expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.734182:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007258 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.734191:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007258 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.734199:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007258 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.734208:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af430500725f lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.734212:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af430500725f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.734216:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af430500725f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.734264:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007258 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.734268:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007258 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.734272:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007258 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.734275:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd9b600 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.734278:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007258 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.734283:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007258 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.734289:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.734290:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.734292:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007258 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.734296:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007258 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.734303:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af430500725f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.734307:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af430500725f lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.734310:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af430500725f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.734314:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd9b3c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.734316:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af430500725f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.734320:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af430500725f lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.734324:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x4f529a91 (ffff880129f26b00) 00010000:00010000:1.0:1715205775.734326:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.734327:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af430500725f lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.734335:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af430500725f lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.734359:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af4305007251 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2364f expref: 163 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.734364:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af4305007251 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2364f expref: 163 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.734370:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9a640, rc 0) 00010000:00000080:1.0:1715205775.734374:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6ff200 x1798520455757376/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.734409:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6ff200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:11754:x1798520455757376:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 289us (374us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205775.734415:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1830 00000100:00100000:0.0:1715205775.735661:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.735740:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455757440 00000100:00100000:3.0:1715205775.735780:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1831 00000100:00100000:3.0:1715205775.735783:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ee3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:11754:x1798520455757440:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.735791:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.735800:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007266 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23656 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.735815:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007266 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23656 expref: 163 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.735822:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007266 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23656 expref: 163 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.735826:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205775.735828:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205775.735829:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73acfc0, rc 0) 00010000:00000080:3.0:1715205775.735833:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910ee3c0 x1798520455757440/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 328/344 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.735876:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ee3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+163:11754:x1798520455757440:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 91us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.735881:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1831 00000100:00100000:2.0:1715205775.737459:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.737529:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455757504 00000100:00100000:0.0:1715205775.737575:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 476 00000100:00100000:0.0:1715205775.737580:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d442600 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+163:11754:x1798520455757504:12345-192.168.204.8@tcp:37:dbench.0 00010000:00000080:0.0:1715205775.739534:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d442600 x1798520455757504/t0(0) o37->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 448/440 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.739600:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d442600 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+163:11754:x1798520455757504:12345-192.168.204.8@tcp:37:dbench.0 Request processed in 2019us (2143us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.739609:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 476 00000100:00100000:2.0:1715205775.740992:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.741061:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455757632 00000100:00100000:0.0:1715205775.741091:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 477 00000100:00100000:0.0:1715205775.741095:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4404c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+163:11754:x1798520455757632:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.741288:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4404c0 x1798520455757632/t330712482590(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.741314:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4404c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+164:11754:x1798520455757632:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 219us (323us total) trans 330712482590 rc 0/0 00000100:00100000:0.0:1715205775.741320:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 477 00000100:00100000:2.0:1715205775.742397:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.742448:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455757760 00000100:00100000:1.0:1715205775.742485:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1832 00000100:00100000:1.0:1715205775.742488:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d445f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+164:11754:x1798520455757760:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.742500:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.742514:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af430500726d lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2365d expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.742570:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99b00/0xb608af4305007274 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.742586:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305007021 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23584 expref: 165 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.742593:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99b00/0xb608af4305007274 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.742640:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305007021 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23584 expref: 165 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.742650:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305007021 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23584 expref: 165 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.742660:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456030592:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.742702:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b43c0 going to sleep for 6 seconds 00000100:00100000:1.0:1715205775.743584:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456030592:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205775.743599:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99b00/0xb608af4305007274 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205775.744060:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.744105:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455757824 00010000:00010000:0.0:1715205775.744120:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305007021 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23584 expref: 166 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.744140:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4699 00000100:00100000:0.0:1715205775.744143:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d440e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+166:1831:x1798520455757824:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205775.744149:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.744152:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305007021 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23584 expref: 166 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.744160:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305007021 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23584 expref: 166 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.744171:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305007021 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23584 expref: 166 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.744180:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:0.0:1715205775.744183:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99b00/0xb608af4305007274 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.744189:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99b00/0xb608af4305007274 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.744194:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99b00/0xb608af4305007274 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.744217:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205775.744238:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99b00/0xb608af4305007274 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.744244:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d440e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+165:1831:x1798520455757824:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 99us (184us total) trans 0 rc 0/0 00010000:00010000:1.0:1715205775.744245:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99b00/0xb608af4305007274 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.744250:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4699 00000004:00200000:1.0:1715205775.744258:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeec:0x0]: returning size 260096 00010000:00010000:1.0:1715205775.744350:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af430500726d lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2365d expref: 166 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.744378:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99b00/0xb608af4305007274 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2365d expref: 165 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.744384:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:1.0:1715205775.744386:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205775.744387:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd99b00, rc 0) 00010000:00000080:1.0:1715205775.744390:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d445f00 x1798520455757760/t330712482591(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.744420:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d445f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+165:11754:x1798520455757760:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1930us (2024us total) trans 330712482591 rc 0/0 00000100:00100000:1.0:1715205775.744425:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1832 00000100:00100000:2.0:1715205775.745340:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.745377:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455757888 00000100:00100000:1.0:1715205775.745399:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1833 00000100:00100000:1.0:1715205775.745403:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d446880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+165:11754:x1798520455757888:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.745414:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.745423:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007282 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23664 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.745452:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007289 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.745459:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99b00/0xb608af4305007274 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2365d expref: 166 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.745462:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007289 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.745480:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99b00/0xb608af4305007274 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2365d expref: 166 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.745485:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99b00/0xb608af4305007274 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2365d expref: 166 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.745492:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456030656:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.745549:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b43c0 going to sleep for 6 seconds 00000100:00100000:1.0:1715205775.746205:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456030656:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205775.746218:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007289 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205775.746469:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.746817:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455757952 00010000:00010000:0.0:1715205775.746834:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99b00/0xb608af4305007274 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2365d expref: 167 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.746853:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4700 00000100:00100000:0.0:1715205775.746856:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a482140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:1830:x1798520455757952:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1715205775.746863:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.746867:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99b00/0xb608af4305007274 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2365d expref: 167 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.746874:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99b00/0xb608af4305007274 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2365d expref: 167 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.746887:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99b00/0xb608af4305007274 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2365d expref: 167 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.746895:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:0.0:1715205775.746898:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007289 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.746904:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007289 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.746908:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007289 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.746934:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205775.746953:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a482140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+166:1830:x1798520455757952:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 97us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.746959:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4700 00010000:00010000:1.0:1715205775.747016:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007289 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.747022:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007289 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205775.747047:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeec:0x0]: returning size 260096 00000004:00200000:1.0:1715205775.747050:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205775.747061:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007289 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.747067:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007289 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.747082:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007282 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23664 expref: 166 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.747094:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007289 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23664 expref: 165 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.747099:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:1.0:1715205775.747101:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205775.747102:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9aac0, rc 0) 00010000:00000080:1.0:1715205775.747106:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d446880 x1798520455757888/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.747128:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d446880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+165:11754:x1798520455757888:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1725us (1789us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.747133:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1833 00000100:00100000:2.0:1715205775.748768:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.748853:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455758016 00000100:00100000:1.0:1715205775.748892:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1834 00000100:00100000:1.0:1715205775.748896:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a481300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+165:11754:x1798520455758016:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.748909:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.748921:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007290 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2366b expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.748956:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007297 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.748965:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007297 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.748972:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007297 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.748986:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500729e lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.748991:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500729e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.748995:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500729e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.749046:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007297 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.749051:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007297 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.749055:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007297 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.749060:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd9bcc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.749062:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007297 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.749067:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007297 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.749074:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.749076:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.749078:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007297 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.749085:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007297 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.749093:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500729e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.749098:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500729e lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.749101:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500729e lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.749105:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd99200 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.749106:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500729e lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.749109:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500729e lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.749114:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x4f529a91 (ffff880129f26c00) 00010000:00010000:1.0:1715205775.749115:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.749116:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500729e lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.749120:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500729e lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.749146:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007290 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2366b expref: 166 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.749155:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007290 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2366b expref: 166 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.749161:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9a880, rc 0) 00010000:00000080:1.0:1715205775.749164:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009a481300 x1798520455758016/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.749206:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a481300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+165:11754:x1798520455758016:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 309us (441us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205775.749211:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1834 00000100:00100000:2.0:1715205775.751114:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.751202:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455758144 00000100:00100000:0.0:1715205775.751236:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 478 00000100:00100000:0.0:1715205775.751240:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091812850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+165:11754:x1798520455758144:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.751376:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880091812850 x1798520455758144/t330712482592(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.751424:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091812850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+166:11754:x1798520455758144:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 183us (314us total) trans 330712482592 rc 0/0 00000100:00100000:0.0:1715205775.751431:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 478 00000100:00100000:2.0:1715205775.752797:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205775.752868:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455758272 00000100:00100000:3.0:1715205775.752901:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1835 00000100:00100000:3.0:1715205775.752905:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a484c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+166:11754:x1798520455758272:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205775.752916:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205775.752928:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af43050072a5 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23672 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.752982:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050072ac lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.752993:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007289 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23664 expref: 167 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.752998:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050072ac lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.753022:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007289 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23664 expref: 167 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.753031:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007289 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23664 expref: 167 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.753041:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6fe3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456030720:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205775.753079:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b9d10c0 going to sleep for 6 seconds 00000100:00100000:0.0:1715205775.755860:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009e6fe3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456030720:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205775.755884:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050072ac lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205775.756404:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.756458:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455758336 00010000:00010000:0.0:1715205775.756483:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007289 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23664 expref: 168 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.756515:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4701 00000100:00100000:0.0:1715205775.756520:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a483900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+168:1831:x1798520455758336:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1715205775.756529:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.756533:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007289 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23664 expref: 168 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.756541:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007289 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23664 expref: 168 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.756556:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007289 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23664 expref: 168 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.756566:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:0.0:1715205775.756569:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050072ac lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.756575:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050072ac lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.756584:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050072ac lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.756604:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205775.756638:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050072ac lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.756645:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050072ac lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.756657:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a483900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:1831:x1798520455758336:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 137us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.756661:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4701 00000004:00200000:2.0:1715205775.756666:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeec:0x0]: returning size 260096 00010000:00010000:2.0:1715205775.756794:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af43050072a5 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23672 expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.756820:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050072ac lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23672 expref: 167 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.756826:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:2.0:1715205775.756828:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205775.756829:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ae400, rc 0) 00010000:00000080:2.0:1715205775.756832:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009a484c00 x1798520455758272/t330712482593(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.756863:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a484c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455758272:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 3957us (4067us total) trans 330712482593 rc 0/0 00000100:00100000:2.0:1715205775.756869:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1835 00000100:00100000:2.0:1715205775.758352:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.758430:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455758400 00000100:00100000:0.0:1715205775.758464:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1836 00000100:00100000:0.0:1715205775.758468:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a480e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455758400:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.758482:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.758493:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af43050072ba lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23679 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.758529:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af43050072c1 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.758539:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050072ac lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23672 expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.758544:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af43050072c1 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.758564:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050072ac lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23672 expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.758571:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050072ac lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23672 expref: 168 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.758585:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800910e9c80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456030784:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205775.758655:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134a1f540 going to sleep for 6 seconds 00000100:00100000:2.0:1715205775.759545:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800910e9c80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456030784:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205775.759574:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af43050072c1 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205775.760123:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.760194:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455758464 00010000:00010000:0.0:1715205775.760221:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050072ac lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23672 expref: 169 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.760255:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4702 00000100:00100000:0.0:1715205775.760260:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b521a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+169:1830:x1798520455758464:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1715205775.760272:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.760276:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050072ac lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23672 expref: 169 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.760284:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050072ac lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23672 expref: 169 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.760302:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050072ac lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23672 expref: 169 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.760316:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:0.0:1715205775.760319:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af43050072c1 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.760326:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af43050072c1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.760332:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af43050072c1 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.760354:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205775.760373:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af43050072c1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.760380:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af43050072c1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.760398:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b521a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+168:1830:x1798520455758464:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 138us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.760405:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4702 00000004:00200000:2.0:1715205775.760417:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeec:0x0]: returning size 260096 00000004:00200000:2.0:1715205775.760421:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205775.760435:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af43050072c1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.760443:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af43050072c1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.760465:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af43050072ba lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23679 expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.760477:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af43050072c1 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23679 expref: 167 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.760483:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:2.0:1715205775.760485:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205775.760487:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c1680, rc 0) 00010000:00000080:2.0:1715205775.760492:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009a480e40 x1798520455758400/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.760520:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a480e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455758400:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2051us (2172us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.760526:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1836 00000100:00100000:0.0:1715205775.761980:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.762030:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455758528 00000100:00100000:2.0:1715205775.762061:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1837 00000100:00100000:2.0:1715205775.762065:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910e97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455758528:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.762081:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.762092:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af43050072c8 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23680 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.762131:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af43050072cf lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.762140:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af43050072cf lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.762148:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af43050072cf lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.762159:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af43050072d6 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.762165:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af43050072d6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.762170:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af43050072d6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.762239:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af43050072cf lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.762245:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af43050072cf lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.762250:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af43050072cf lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.762255:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940c8fc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.762258:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af43050072cf lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.762263:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af43050072cf lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.762270:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205775.762272:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.762275:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af43050072cf lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.762279:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8fc0/0xb608af43050072cf lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.762286:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af43050072d6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.762289:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af43050072d6 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.762297:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af43050072d6 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.762301:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940c9b00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.762302:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af43050072d6 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.762305:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af43050072d6 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.762311:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x5a9c1470 (ffff88008f367d00) 00010000:00010000:2.0:1715205775.762312:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.762313:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af43050072d6 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.762318:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9b00/0xb608af43050072d6 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.762346:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af43050072c8 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23680 expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.762353:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca640/0xb608af43050072c8 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23680 expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.762359:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940ca640, rc 0) 00010000:00000080:2.0:1715205775.762363:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910e97c0 x1798520455758528/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.762401:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910e97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455758528:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 335us (424us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205775.762407:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1837 00000100:00100000:3.0:1715205775.763337:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.763401:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455758592 00000100:00100000:2.0:1715205775.763437:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1838 00000100:00100000:2.0:1715205775.763441:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fc280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455758592:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.763453:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.763465:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af43050072dd lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23687 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.763503:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af43050072e4 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.763518:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af43050072e4 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.763525:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af43050072e4 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.763533:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af43050072eb lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.763536:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af43050072eb lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.763539:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af43050072eb lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.763583:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af43050072e4 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.763589:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af43050072e4 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.763592:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af43050072e4 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.763595:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940ca880 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.763596:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af43050072e4 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.763599:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af43050072e4 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.763605:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205775.763606:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.763608:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af43050072e4 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.763610:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca880/0xb608af43050072e4 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.763616:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af43050072eb lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.763647:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af43050072eb lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.763651:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af43050072eb lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.763658:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940c8480 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.763659:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af43050072eb lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.763663:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af43050072eb lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.763668:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x5ae91372 (ffff88008f367100) 00010000:00010000:2.0:1715205775.763670:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.763671:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af43050072eb lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.763674:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8480/0xb608af43050072eb lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.763732:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af43050072dd lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23687 expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.763738:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb600/0xb608af43050072dd lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23687 expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.763757:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940cb600, rc 0) 00010000:00000080:2.0:1715205775.763762:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6fc280 x1798520455758592/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.763800:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fc280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455758592:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 359us (469us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205775.763804:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1838 00000100:00100000:0.0:1715205775.765261:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.765316:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455758720 00000100:00100000:2.0:1715205775.765347:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1839 00000100:00100000:2.0:1715205775.765352:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455758720:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.765362:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.765372:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8900/0xb608af43050072f2 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2368e expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.765429:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af43050072f9 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.765439:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af43050072f9 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.765445:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af43050072f9 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.765455:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305007300 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.765460:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305007300 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.765465:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305007300 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.765490:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af43050072f9 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.765496:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af43050072f9 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.765504:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af43050072f9 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.765509:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940c9d40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.765511:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af43050072f9 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.765517:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af43050072f9 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.765524:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205775.765526:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.765528:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af43050072f9 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.765532:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9d40/0xb608af43050072f9 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.765540:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305007300 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.765545:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305007300 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.765549:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305007300 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.765552:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940c8240 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.765553:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305007300 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.765559:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305007300 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.765563:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x5ae91372 (ffff8800b410fe00) 00010000:00010000:2.0:1715205775.765565:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.765566:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305007300 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.765570:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8240/0xb608af4305007300 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.765589:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8900/0xb608af43050072f2 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2368e expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.765594:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8900/0xb608af43050072f2 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2368e expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.765600:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940c8900, rc 0) 00010000:00000080:2.0:1715205775.765603:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910eda40 x1798520455758720/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 656/600 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.765668:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455758720:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 315us (410us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205775.765673:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1839 00000100:00100000:0.0:1715205775.767105:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.767172:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455758784 00000100:00100000:2.0:1715205775.767210:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1840 00000100:00100000:2.0:1715205775.767218:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910e84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455758784:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.767237:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.767250:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cbcc0/0xb608af4305007307 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23695 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.767294:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af430500730e lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.767304:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af430500730e lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.767313:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af430500730e lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.767324:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8000/0xb608af4305007315 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.767329:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8000/0xb608af4305007315 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.767334:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8000/0xb608af4305007315 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.767385:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af430500730e lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.767391:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af430500730e lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.767396:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af430500730e lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.767405:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940c9200 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.767407:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af430500730e lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.767411:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af430500730e lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.767419:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205775.767421:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.767423:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af430500730e lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.767427:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9200/0xb608af430500730e lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.767437:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8000/0xb608af4305007315 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.767442:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8000/0xb608af4305007315 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.767446:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8000/0xb608af4305007315 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.767450:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940c8000 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.767451:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8000/0xb608af4305007315 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.767456:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8000/0xb608af4305007315 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.767462:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x5a9c1470 (ffff88012f497e00) 00010000:00010000:2.0:1715205775.767464:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.767465:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8000/0xb608af4305007315 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.767469:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8000/0xb608af4305007315 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.767502:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cbcc0/0xb608af4305007307 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23695 expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.767509:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cbcc0/0xb608af4305007307 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23695 expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.767517:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940cbcc0, rc 0) 00010000:00000080:2.0:1715205775.767526:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910e84c0 x1798520455758784/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.767577:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910e84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455758784:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 361us (476us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205775.767583:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1840 00000100:00100000:3.0:1715205775.769962:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.770019:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455758912 00000100:00100000:2.0:1715205775.770059:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1841 00000100:00100000:2.0:1715205775.770064:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fcc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455758912:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.770077:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.770088:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af430500731c lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2369c expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.770164:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305007323 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.770171:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305007323 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.770177:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305007323 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.770184:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8d80/0xb608af430500732a lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.770187:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8d80/0xb608af430500732a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.770190:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8d80/0xb608af430500732a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.770209:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305007323 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.770211:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305007323 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.770214:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305007323 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.770217:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940caac0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.770218:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305007323 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.770223:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305007323 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.770228:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205775.770229:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.770231:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305007323 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.770234:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940caac0/0xb608af4305007323 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.770244:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8d80/0xb608af430500732a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.770248:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8d80/0xb608af430500732a lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.770253:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8d80/0xb608af430500732a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.770257:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940c8d80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.770258:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8d80/0xb608af430500732a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.770263:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8d80/0xb608af430500732a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.770268:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x5a9c1470 (ffff88009bcc4600) 00010000:00010000:2.0:1715205775.770270:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.770272:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8d80/0xb608af430500732a lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.770276:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8d80/0xb608af430500732a lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.770298:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af430500731c lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2369c expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.770305:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cad00/0xb608af430500731c lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2369c expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.770311:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940cad00, rc 0) 00010000:00000080:2.0:1715205775.770315:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6fcc00 x1798520455758912/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 656/600 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.770364:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fcc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455758912:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 299us (406us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205775.770370:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1841 00000100:00100000:0.0:1715205775.771516:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.771585:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455758976 00000100:00100000:2.0:1715205775.771615:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1842 00000100:00100000:2.0:1715205775.771642:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910e9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455758976:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.771656:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.771670:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305007331 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b236a3 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.771722:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cba80/0xb608af4305007338 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.771733:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cba80/0xb608af4305007338 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.771742:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cba80/0xb608af4305007338 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.771765:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af430500733f lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.771770:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af430500733f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.771776:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af430500733f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.771835:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cba80/0xb608af4305007338 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.771841:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cba80/0xb608af4305007338 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.771845:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cba80/0xb608af4305007338 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.771850:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800940cba80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.771852:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cba80/0xb608af4305007338 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.771857:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cba80/0xb608af4305007338 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.771866:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205775.771869:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.771871:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cba80/0xb608af4305007338 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.771875:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cba80/0xb608af4305007338 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.771883:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af430500733f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.771886:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af430500733f lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.771890:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af430500733f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.771893:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedeac0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.771894:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af430500733f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.771898:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af430500733f lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.771903:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x5ae91372 (ffff88008ecaa200) 00010000:00010000:2.0:1715205775.771904:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.771905:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af430500733f lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.771909:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af430500733f lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.771940:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305007331 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236a3 expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.771945:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb840/0xb608af4305007331 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236a3 expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.771950:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800940cb840, rc 0) 00010000:00000080:2.0:1715205775.771953:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910e9300 x1798520455758976/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.772001:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910e9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455758976:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 363us (488us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205775.772007:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1842 00000100:00100000:0.0:1715205775.775115:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.775202:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455759104 00000100:00100000:2.0:1715205775.775249:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1843 00000100:00100000:2.0:1715205775.775254:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910e9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455759104:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.775265:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.775276:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af4305007346 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b236aa expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.775515:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500734d lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.775523:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500734d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.775529:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500734d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.775538:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc240/0xb608af4305007354 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.775542:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc240/0xb608af4305007354 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.775546:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc240/0xb608af4305007354 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.775571:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500734d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.775576:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500734d lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.775579:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500734d lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.775582:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedc900 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.775584:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500734d lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.775588:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500734d lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.775592:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205775.775593:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.775595:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500734d lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.775600:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500734d lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.775606:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc240/0xb608af4305007354 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.775608:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc240/0xb608af4305007354 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.775611:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc240/0xb608af4305007354 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.775613:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedc240 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.775614:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc240/0xb608af4305007354 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.775616:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc240/0xb608af4305007354 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.775636:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x5ae91372 (ffff8800a6d13700) 00010000:00010000:2.0:1715205775.775637:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.775638:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc240/0xb608af4305007354 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.775640:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc240/0xb608af4305007354 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.775656:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af4305007346 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236aa expref: 168 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.775662:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af4305007346 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236aa expref: 168 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.775666:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedfa80, rc 0) 00010000:00000080:2.0:1715205775.775669:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910e9c80 x1798520455759104/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 656/600 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.775806:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910e9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455759104:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 552us (697us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205775.775809:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1843 00000100:00100000:3.0:1715205775.777266:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.777312:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455759168 00000100:00100000:2.0:1715205775.777466:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1844 00000100:00100000:2.0:1715205775.777470:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455759168:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.777516:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.777524:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af430500735b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b236b1 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.777547:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007362 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.777554:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007362 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.777560:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007362 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.777569:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af4305007369 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.777574:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af4305007369 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.777578:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af4305007369 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.777610:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007362 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.777614:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007362 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.777636:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007362 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.777640:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eeddd40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.777642:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007362 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.777646:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007362 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.777652:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205775.777654:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.777655:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007362 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.777659:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007362 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.777669:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af4305007369 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.777673:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af4305007369 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.777677:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af4305007369 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.777681:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedf3c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.777682:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af4305007369 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.777687:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af4305007369 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.777692:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x5a9c1470 (ffff8800a6d13e00) 00010000:00010000:2.0:1715205775.777693:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.777694:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af4305007369 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.778030:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af4305007369 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.778065:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af430500735b lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236b1 expref: 168 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.778070:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af430500735b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236b1 expref: 168 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.778076:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedcb40, rc 0) 00010000:00000080:2.0:1715205775.778079:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6f8000 x1798520455759168/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.778164:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455759168:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 692us (899us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205775.778170:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1844 00000100:00100000:0.0:1715205775.780428:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.780531:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455759296 00000100:00100000:2.0:1715205775.780574:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1845 00000100:00100000:2.0:1715205775.780579:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910eb900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455759296:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.780597:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.780599:0:14185:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1715205775.780649:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007266 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23656 expref: 167 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.780669:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205775.780672:0:14185:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205775.780683:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af4305007370 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b236b8 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.780806:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007377 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.780818:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007377 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.780825:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007377 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.780837:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500737e lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.780843:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500737e lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.780847:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500737e lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715205775.781206:0:14185:0:(osp_object.c:1645:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x100000000:0x17b9:0x0], index 0: 0 00010000:00010000:2.0:1715205775.781350:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc480/0xb608af4305007385 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.781357:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc480/0xb608af4305007385 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.781363:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc480/0xb608af4305007385 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.781391:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007377 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.781397:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007377 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.781402:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007377 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.781408:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedc000 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.781412:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007377 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.781417:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007377 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.781424:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205775.781426:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.781428:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007377 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.781432:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007377 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715205775.781440:0:14185:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff8800910eb900 reply state ffff8800a10a9000 transno 330712482594 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500737e lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.781459:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af4305007370 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236b8 expref: 169 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.781467:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc480/0xb608af4305007385 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236b8 expref: 168 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.781473:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1011:0x0].0x0 (ffff8800a6d13f00) 00010000:00010000:2.0:1715205775.781474:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1715205775.781476:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedc480, rc 0) 00010000:00000080:2.0:1715205775.781480:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910eb900 x1798520455759296/t330712482594(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 656/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.781542:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910eb900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+169:11754:x1798520455759296:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 961us (1120us total) trans 330712482594 rc 0/0 00000100:00100000:2.0:1715205775.781549:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1845 00010000:00010000:2.0:1715205775.782895:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500737e lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.782902:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500737e lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.782907:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500737e lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.782911:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedc6c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.782913:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500737e lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.782919:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500737e lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.782927:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x5a9c1470 (ffff8800a6d13700) 00010000:00010000:2.0:1715205775.782929:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.782931:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500737e lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.782935:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500737e lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.783343:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.783408:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455759360 00000100:00100000:2.0:1715205775.783440:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1846 00000100:00100000:2.0:1715205775.783444:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d440e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+168:11754:x1798520455759360:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.783459:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.783465:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeded00/0xb608af4305007393 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b236bf expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.783499:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af430500739a lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.783508:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af430500739a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.783516:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af430500739a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205775.783537:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205775.783546:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af430500739a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.783552:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af430500739a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.783566:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeded00/0xb608af4305007393 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236bf expref: 170 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.783575:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af430500739a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236bf expref: 169 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.783586:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1011:0x0].0x0 (ffff8800a6d13f00) 00010000:00010000:2.0:1715205775.783588:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205775.783589:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eede640, rc 0) 00010000:00000080:2.0:1715205775.783593:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d440e40 x1798520455759360/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.783656:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d440e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+169:11754:x1798520455759360:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 210us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.783661:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1846 00000100:00100000:0.0:1715205775.785020:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.785088:0:19961:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455759424 00000100:00100000:1.0:1715205775.785135:0:19961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14685 00000100:00100000:1.0:1715205775.785141:0:19961:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d442600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+38:1831:x1798520455759424:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.785154:0:19961:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.785169:0:19961:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bd9aac0/0xb608af43050073a1 lrc: 2/0,0 mode: --/PR res: [0x17b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b236c6 expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1715205775.785189:0:19961:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x17b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1715205775.785201:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205775.785202:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205775.785208:0:19961:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bd9aac0/0xb608af43050073a1 lrc: 3/0,0 mode: PR/PR res: [0x17b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236c6 expref: 39 pid: 19961 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1715205775.785216:0:19961:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bd9aac0/0xb608af43050073a1 lrc: 3/0,0 mode: PR/PR res: [0x17b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236c6 expref: 39 pid: 19961 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1715205775.785223:0:19961:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9aac0, rc 0) 00000100:00100000:1.0:1715205775.785260:0:19961:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d442600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+39:1831:x1798520455759424:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 119us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.785266:0:19961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14685 00000100:00100000:3.0:1715205775.787084:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.787135:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455759552 00000100:00100000:0.0:1715205775.787178:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 479 00000100:00100000:0.0:1715205775.787183:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fe880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+169:11754:x1798520455759552:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.787467:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6fe880 x1798520455759552/t330712482595(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.787517:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fe880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+170:11754:x1798520455759552:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 333us (437us total) trans 330712482595 rc 0/0 00000100:00100000:0.0:1715205775.787524:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 479 00000100:00100000:0.0:1715205775.788773:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.788849:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455759680 00000100:00100000:2.0:1715205775.788902:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1847 00000100:00100000:2.0:1715205775.788907:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4404c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+170:11754:x1798520455759680:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.788925:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.788941:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050073a8 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b236cd expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.789010:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedd8c0/0xb608af43050073af lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.789022:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af430500739a lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236bf expref: 171 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.789026:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedd8c0/0xb608af43050073af lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.789053:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af430500739a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236bf expref: 171 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.789061:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af430500739a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236bf expref: 171 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.789071:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009a482f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456030848:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205775.789135:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a6ea0d80 going to sleep for 6 seconds 00000100:00100000:0.0:1715205775.790182:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009a482f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456030848:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205775.790199:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedd8c0/0xb608af43050073af lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.790363:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.790421:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455759744 00010000:00010000:2.0:1715205775.790435:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af430500739a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236bf expref: 172 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.790459:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4703 00000100:00100000:2.0:1715205775.790462:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1776880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+172:1831:x1798520455759744:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1715205775.790470:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205775.790474:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af430500739a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236bf expref: 172 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.790481:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af430500739a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236bf expref: 172 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.790492:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af430500739a lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236bf expref: 172 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.790501:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1011:0x0].0x0 (ffff8800a6d13f00) 00010000:00010000:2.0:1715205775.790503:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedd8c0/0xb608af43050073af lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.790509:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedd8c0/0xb608af43050073af lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.790513:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedd8c0/0xb608af43050073af lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.790524:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205775.790529:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedd8c0/0xb608af43050073af lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.790533:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedd8c0/0xb608af43050073af lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205775.790542:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1011:0x0]: returning size 0 00000100:00100000:2.0:1715205775.790552:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1776880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:1831:x1798520455759744:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 89us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.790561:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4703 00010000:00010000:0.0:1715205775.790650:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050073a8 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236cd expref: 172 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.790660:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedd8c0/0xb608af43050073af lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236cd expref: 171 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.790665:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1011:0x0].0x0 (ffff8800a6d13f00) 00010000:00010000:0.0:1715205775.790667:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205775.790668:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedd8c0, rc 0) 00010000:00000080:0.0:1715205775.790671:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4404c0 x1798520455759680/t330712482596(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.790708:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4404c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:11754:x1798520455759680:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1801us (1937us total) trans 330712482596 rc 0/0 00000100:00100000:0.0:1715205775.790714:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1847 00000100:00100000:0.0:1715205775.791782:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.791849:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455759808 00000100:00100000:2.0:1715205775.791877:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1848 00000100:00100000:2.0:1715205775.791881:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1773440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:11754:x1798520455759808:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.791892:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.791900:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af43050073bd lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b236d4 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.791926:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050073c4 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.791932:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedd8c0/0xb608af43050073af lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236cd expref: 172 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.791935:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050073c4 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.791947:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedd8c0/0xb608af43050073af lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236cd expref: 172 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.791952:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedd8c0/0xb608af43050073af lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236cd expref: 172 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.791958:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009a482f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456030912:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205775.791986:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a6ea0000 going to sleep for 6 seconds 00000100:00100000:0.0:1715205775.792921:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009a482f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456030912:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205775.792934:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050073c4 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.793255:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.793404:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455759872 00010000:00010000:2.0:1715205775.793417:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedd8c0/0xb608af43050073af lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236cd expref: 173 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.793433:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4704 00000100:00100000:2.0:1715205775.793436:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1772f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+173:1830:x1798520455759872:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1715205775.793443:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205775.793446:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedd8c0/0xb608af43050073af lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236cd expref: 173 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.793452:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedd8c0/0xb608af43050073af lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236cd expref: 173 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.793462:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedd8c0/0xb608af43050073af lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236cd expref: 173 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.793470:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1011:0x0].0x0 (ffff8800a6d13f00) 00010000:00010000:2.0:1715205775.793472:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050073c4 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.793477:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050073c4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.793481:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050073c4 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.793499:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205775.793520:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1772f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+172:1830:x1798520455759872:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 84us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.793525:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4704 00010000:00010000:1.0:1715205775.793538:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050073c4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.793545:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050073c4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205775.793577:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1011:0x0]: returning size 0 00000004:00200000:1.0:1715205775.793580:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205775.793590:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050073c4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.793597:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050073c4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.793611:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af43050073bd lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236d4 expref: 172 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.793651:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050073c4 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236d4 expref: 171 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.793657:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1011:0x0].0x0 (ffff8800a6d13f00) 00010000:00010000:1.0:1715205775.793658:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205775.793660:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedef40, rc 0) 00010000:00000080:1.0:1715205775.793663:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1773440 x1798520455759808/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.793696:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1773440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:11754:x1798520455759808:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1815us (1915us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.793702:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1848 00000100:00100000:0.0:1715205775.794983:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.795074:0:19961:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455759936 00000100:00100000:1.0:1715205775.795106:0:19961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14686 00000100:00100000:1.0:1715205775.795110:0:19961:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66de880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+39:11754:x1798520455759936:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.795120:0:19961:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.795131:0:19961:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bd99b00/0xb608af43050073cb lrc: 2/0,0 mode: --/PW res: [0x17b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b236db expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.795148:0:19961:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bd9aac0/0xb608af43050073a1 lrc: 2/0,0 mode: PR/PR res: [0x17b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236c6 expref: 40 pid: 19961 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1715205775.795154:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205775.795155:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205775.795157:0:19961:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bd99b00/0xb608af43050073cb lrc: 4/0,0 mode: --/PW res: [0x17b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236db expref: 40 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.795174:0:19961:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bd9aac0/0xb608af43050073a1 lrc: 3/0,0 mode: PR/PR res: [0x17b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236c6 expref: 40 pid: 19961 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1715205775.795183:0:19961:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bd9aac0/0xb608af43050073a1 lrc: 4/0,0 mode: PR/PR res: [0x17b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236c6 expref: 40 pid: 19961 timeout: 3135 lvb_type: 1 00000100:00100000:1.0:1715205775.795190:0:19961:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:19961:1798520456030976:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.795227:0:19961:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b43c0 going to sleep for 6 seconds 00000100:00100000:1.0:1715205775.796185:0:19961:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:19961:1798520456030976:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205775.796199:0:19961:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bd99b00/0xb608af43050073cb lrc: 3/0,0 mode: --/PW res: [0x17b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236db expref: 40 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.796208:0:19961:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd99b00, rc 0) 00000100:00100000:1.0:1715205775.796228:0:19961:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66de880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+40:11754:x1798520455759936:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1117us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.796238:0:19961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14686 00000100:00100000:3.0:1715205775.796554:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.796601:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455760000 00010000:00010000:0.0:1715205775.796614:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bd9aac0/0xb608af43050073a1 lrc: 4/0,0 mode: PR/PR res: [0x17b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236c6 expref: 40 pid: 19961 timeout: 3135 lvb_type: 1 00000100:00100000:0.0:1715205775.796742:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4705 00000100:00100000:0.0:1715205775.796757:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+40:1830:x1798520455760000:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1715205775.796765:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.796779:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bd9aac0/0xb608af43050073a1 lrc: 4/0,0 mode: PR/PR res: [0x17b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236c6 expref: 40 pid: 19961 timeout: 3135 lvb_type: 1 00010000:00010000:0.0:1715205775.796790:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bd9aac0/0xb608af43050073a1 lrc: 3/0,0 mode: PR/PR res: [0x17b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236c6 expref: 40 pid: 19961 timeout: 3135 lvb_type: 1 00010000:00010000:0.0:1715205775.796805:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bd9aac0/0xb608af43050073a1 lrc: 0/0,0 mode: --/PR res: [0x17b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236c6 expref: 40 pid: 19961 timeout: 3135 lvb_type: 1 00010000:00010000:0.0:1715205775.796813:0:6662:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205775.796814:0:6662:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205775.796819:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bd99b00/0xb608af43050073cb lrc: 2/0,0 mode: PW/PW res: [0x17b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236db expref: 39 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.796825:0:6662:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bd99b00/0xb608af43050073cb lrc: 3/0,0 mode: PW/PW res: [0x17b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236db expref: 39 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.796845:0:6662:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bd99b00/0xb608af43050073cb lrc: 3/0,0 mode: PW/PW res: [0x17b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236db expref: 39 pid: 19961 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.796851:0:6662:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a66d8980 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6662:1798520456031040:192.168.204.8@tcp:105: 00000100:00100000:0.0:1715205775.796880:0:6662:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f2480 going to sleep for 6 seconds 00000100:00100000:2.0:1715205775.797837:0:6662:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a66d8980 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6662:1798520456031040:192.168.204.8@tcp:105: 00010000:00010000:2.0:1715205775.797849:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205775.797887:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+39:1830:x1798520455760000:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 1130us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.797893:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4705 00000100:00100000:2.0:1715205775.798551:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.798692:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455760128 00000100:00100000:0.0:1715205775.798742:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 480 00000100:00100000:0.0:1715205775.798762:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a482140 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:11754:x1798520455760128:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.799022:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009a482140 x1798520455760128/t330712482597(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.799729:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a482140 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+172:11754:x1798520455760128:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 967us (1179us total) trans 330712482597 rc 0/0 00000100:00100000:0.0:1715205775.799737:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 480 00000100:00100000:3.0:1715205775.801565:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.801661:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455760256 00000100:00100000:1.0:1715205775.801703:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1849 00000100:00100000:1.0:1715205775.801708:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fd580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+172:11754:x1798520455760256:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.801724:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.801739:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af43050073d2 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b236e2 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.801816:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050073d9 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.801828:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050073c4 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236d4 expref: 173 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.801835:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050073d9 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.801859:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050073c4 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236d4 expref: 173 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.801868:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050073c4 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236d4 expref: 173 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.801877:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456031104:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.801927:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b43c0 going to sleep for 6 seconds 00000100:00100000:1.0:1715205775.803231:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456031104:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205775.803243:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050073d9 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.803571:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.803614:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455760320 00010000:00010000:2.0:1715205775.803648:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050073c4 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236d4 expref: 174 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.803674:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4706 00000100:00100000:2.0:1715205775.803678:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fe3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+174:1830:x1798520455760320:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1715205775.803687:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205775.803691:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050073c4 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236d4 expref: 174 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.803699:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050073c4 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236d4 expref: 174 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.803711:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050073c4 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236d4 expref: 174 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.803720:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1011:0x0].0x0 (ffff8800a6d13f00) 00010000:00010000:2.0:1715205775.803722:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050073d9 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.803728:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050073d9 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.803736:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050073d9 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.803763:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205775.803791:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fe3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+173:1830:x1798520455760320:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 112us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.803796:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4706 00010000:00010000:1.0:1715205775.803798:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050073d9 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.803805:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050073d9 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205775.803818:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1011:0x0]: returning size 2048 00010000:00010000:1.0:1715205775.803911:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af43050073d2 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236e2 expref: 174 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.803939:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050073d9 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236e2 expref: 173 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.803945:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1011:0x0].0x0 (ffff8800a6d13f00) 00010000:00010000:1.0:1715205775.803947:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205775.803948:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9b3c0, rc 0) 00010000:00000080:1.0:1715205775.803952:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6fd580 x1798520455760256/t330712482598(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.803992:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fd580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+173:11754:x1798520455760256:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2283us (2431us total) trans 330712482598 rc 0/0 00000100:00100000:1.0:1715205775.803999:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1849 00000100:00100000:3.0:1715205775.805301:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.805340:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455760384 00000100:00100000:1.0:1715205775.805361:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1850 00000100:00100000:1.0:1715205775.805364:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+173:11754:x1798520455760384:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.805375:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.805381:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050073e7 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b236e9 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.805410:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af43050073ee lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.805418:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050073d9 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236e2 expref: 174 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.805423:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af43050073ee lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.805440:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050073d9 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236e2 expref: 174 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.805448:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050073d9 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236e2 expref: 174 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.805457:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456031168:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.805492:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b43c0 going to sleep for 6 seconds 00000100:00100000:2.0:1715205775.807880:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.807898:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456031168:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205775.807918:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af43050073ee lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.807929:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455760448 00010000:00010000:3.0:1715205775.807951:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050073d9 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236e2 expref: 175 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:3.0:1715205775.807980:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4707 00000100:00100000:3.0:1715205775.807984:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a483900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+175:1830:x1798520455760448:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1715205775.807992:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205775.807995:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050073d9 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236e2 expref: 175 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.808000:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050073d9 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236e2 expref: 175 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.808011:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050073d9 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236e2 expref: 175 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:3.0:1715205775.808026:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1011:0x0].0x0 (ffff8800a6d13f00) 00010000:00010000:3.0:1715205775.808028:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af43050073ee lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.808036:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af43050073ee lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.808040:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af43050073ee lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205775.808054:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205775.808070:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af43050073ee lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.808078:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af43050073ee lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.808085:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a483900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+174:1830:x1798520455760448:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 100us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.808089:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4707 00000004:00200000:1.0:1715205775.808106:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1011:0x0]: returning size 2048 00000004:00200000:1.0:1715205775.808109:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205775.808120:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af43050073ee lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.808127:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af43050073ee lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.808142:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050073e7 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236e9 expref: 174 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.808151:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af43050073ee lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236e9 expref: 173 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.808156:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1011:0x0].0x0 (ffff8800a6d13f00) 00010000:00010000:1.0:1715205775.808158:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205775.808159:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd98d80, rc 0) 00010000:00000080:1.0:1715205775.808162:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6f8980 x1798520455760384/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.808198:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+173:11754:x1798520455760384:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2832us (2899us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.808203:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1850 00000100:00100000:2.0:1715205775.810869:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.810939:0:18729:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455760512 00002000:00100000:0.0:1715205775.810981:0:18729:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x15d9:0x0] (0->4095) req@ffff88009a482f80 x1798520455760512/t0(0) o4->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 4584/0 e 0 to 0 dl 1715205781 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dbench.0' 00002000:00100000:0.0:1715205775.810990:0:18729:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a482f80 with x1798520455760512 ext(0->4095) 00002000:00010000:0.0:1715205775.810996:0:18729:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a482f80 00000100:00100000:0.0:1715205775.811024:0:18729:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 738 00000100:00100000:0.0:1715205775.811029:0:18729:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a482f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+53:1831:x1798520455760512:12345-192.168.204.8@tcp:4:dbench.0 00000100:00100000:0.0:1715205775.811483:0:18729:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a482f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+55:1831:x1798520455760512:12345-192.168.204.8@tcp:4:dbench.0 Request processed in 453us (618us total) trans 4294970699 rc 0/0 00000100:00100000:0.0:1715205775.811491:0:18729:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 738 00002000:00100000:0.0:1715205775.811497:0:18729:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x15d9:0x0] (0->4095) req@ffff88009a482f80 x1798520455760512/t4294970699(0) o4->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 4584/448 e 0 to 0 dl 1715205781 ref 1 fl Complete:/0/0 rc 0/0 job:'dbench.0' 00002000:00100000:0.0:1715205775.811503:0:18729:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a482f80 with x1798520455760512 ext(0->4095) 00002000:00010000:0.0:1715205775.811505:0:18729:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a482f80 00000100:00100000:3.0:1715205775.812789:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.812868:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455760576 00000100:00100000:1.0:1715205775.812911:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1851 00000100:00100000:1.0:1715205775.812915:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6f84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+173:11754:x1798520455760576:12345-192.168.204.8@tcp:44:dbench.0 00000001:00080000:0.0:1715205775.823971:0:14242:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-MDT0000: transno 330712482597 is committed 00000001:00080000:0.0:1715205775.824022:0:14242:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-MDT0000: transno 330712482598 is committed 00010000:00000080:3.0:1715205775.824040:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6f84c0 x1798520455760576/t0(0) o44->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 448/440 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205775.824107:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6f84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+120:11754:x1798520455760576:12345-192.168.204.8@tcp:44:dbench.0 Request processed in 11191us (11319us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205775.824115:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1851 00000100:00100000:2.0:1715205775.825273:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.825331:0:19961:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455760640 00000100:00100000:1.0:1715205775.825351:0:19961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14687 00000100:00100000:1.0:1715205775.825354:0:19961:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2263c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+55:1830:x1798520455760640:12345-192.168.204.8@tcp:16:dbench.0 00000100:00100000:0.0:1715205775.851352:0:19961:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2263c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+55:1830:x1798520455760640:12345-192.168.204.8@tcp:16:dbench.0 Request processed in 25992us (26075us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.851362:0:19961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14687 00000001:00080000:0.0:1715205775.851391:0:10032:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0001: transno 4294970699 is committed 00000001:00080000:0.0:1715205775.851411:0:10032:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0001: transno 4294970697 is committed 00000001:00080000:0.0:1715205775.851430:0:10032:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0001: transno 4294970698 is committed 00000100:00100000:2.0:1715205775.853286:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.853311:0:18729:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455760704 00002000:00100000:0.0:1715205775.853339:0:18729:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x17b9:0x0] (0->4095) req@ffff88012c225580 x1798520455760704/t0(0) o4->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 4584/0 e 0 to 0 dl 1715205781 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dbench.0' 00002000:00100000:0.0:1715205775.853344:0:18729:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c225580 with x1798520455760704 ext(0->4095) 00002000:00010000:0.0:1715205775.853347:0:18729:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c225580 00000100:00100000:0.0:1715205775.853368:0:18729:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 739 00000100:00100000:0.0:1715205775.853371:0:18729:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c225580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+39:1828:x1798520455760704:12345-192.168.204.8@tcp:4:dbench.0 00000100:00100000:0.0:1715205775.853613:0:18729:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c225580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+41:1828:x1798520455760704:12345-192.168.204.8@tcp:4:dbench.0 Request processed in 240us (327us total) trans 30064771479 rc 0/0 00000100:00100000:0.0:1715205775.853637:0:18729:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 739 00002000:00100000:0.0:1715205775.853641:0:18729:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x17b9:0x0] (0->4095) req@ffff88012c225580 x1798520455760704/t30064771479(0) o4->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 4584/448 e 0 to 0 dl 1715205781 ref 1 fl Complete:/0/0 rc 0/0 job:'dbench.0' 00002000:00100000:0.0:1715205775.853647:0:18729:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c225580 with x1798520455760704 ext(0->4095) 00002000:00010000:0.0:1715205775.853650:0:18729:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c225580 00000100:00100000:3.0:1715205775.855481:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.855518:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455760768 00000100:00100000:0.0:1715205775.855548:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1852 00000100:00100000:0.0:1715205775.855553:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fb900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+120:11754:x1798520455760768:12345-192.168.204.8@tcp:44:dbench.0 00010000:00000080:0.0:1715205775.855596:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6fb900 x1798520455760768/t0(0) o44->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 448/440 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.855662:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fb900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+120:11754:x1798520455760768:12345-192.168.204.8@tcp:44:dbench.0 Request processed in 109us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.855669:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1852 00000100:00100000:2.0:1715205775.856716:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.856758:0:19961:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455760832 00000100:00100000:0.0:1715205775.856777:0:19961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14688 00000100:00100000:0.0:1715205775.856781:0:19961:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c226d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+41:1831:x1798520455760832:12345-192.168.204.8@tcp:16:dbench.0 00000001:00080000:1.0:1715205775.874725:0:24534:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0000: transno 30064771479 is committed 00000001:00080000:1.0:1715205775.874740:0:24534:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0000: transno 30064771477 is committed 00000001:00080000:1.0:1715205775.874758:0:24534:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0000: transno 30064771478 is committed 00000100:00100000:0.0:1715205775.874801:0:19961:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c226d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+39:1831:x1798520455760832:12345-192.168.204.8@tcp:16:dbench.0 Request processed in 18016us (18083us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.874811:0:19961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14688 00000100:00100000:2.0:1715205775.878393:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.878479:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455760896 00000100:00100000:0.0:1715205775.878521:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1853 00000100:00100000:0.0:1715205775.878525:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c227200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+120:11754:x1798520455760896:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.878540:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.878555:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af43050073f5 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b236f0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.878597:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af43050073fc lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.878607:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af43050073fc lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.878616:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af43050073fc lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.878814:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af4305007403 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.878820:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af4305007403 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.878824:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af4305007403 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.878880:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af43050073fc lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.878885:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af43050073fc lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.878889:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af43050073fc lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.878893:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c2640 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.878896:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af43050073fc lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.878900:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af43050073fc lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.878908:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205775.878910:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.878912:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af43050073fc lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.878916:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2640/0xb608af43050073fc lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.878923:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af4305007403 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.878927:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af4305007403 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.878932:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af4305007403 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.878936:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c0480 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.878937:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af4305007403 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.878941:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af4305007403 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.878946:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0xa992fa2d (ffff880135bf2b00) 00010000:00010000:0.0:1715205775.878948:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.878954:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af4305007403 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.878958:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0480/0xb608af4305007403 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.878994:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af43050073f5 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236f0 expref: 121 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.879000:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3cc0/0xb608af43050073f5 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236f0 expref: 121 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.879006:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c3cc0, rc 0) 00010000:00000080:0.0:1715205775.879011:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c227200 x1798520455760896/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.879071:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c227200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+120:11754:x1798520455760896:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 544us (682us total) trans 0 rc 301/301 00000100:00100000:0.0:1715205775.879076:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1853 00010000:00010000:1.0:1715205775.879191:0:11161:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715205775.880572:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.880642:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455760960 00000100:00100000:0.0:1715205775.880677:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1854 00000100:00100000:0.0:1715205775.880681:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+120:11754:x1798520455760960:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.880689:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.880698:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af430500740a lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b236f7 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.880714:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af430500740a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236f7 expref: 121 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.880722:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af430500740a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236f7 expref: 121 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.880727:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205775.880729:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.880731:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009b8c1f80, rc 0) 00010000:00000080:0.0:1715205775.880734:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6a4c740 x1798520455760960/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 328/344 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.880934:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+121:11754:x1798520455760960:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 103us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.880940:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1854 00000100:00100000:2.0:1715205775.881995:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.882038:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455761024 00000100:00100000:0.0:1715205775.882063:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 481 00000100:00100000:0.0:1715205775.882066:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2276c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+121:11754:x1798520455761024:12345-192.168.204.8@tcp:37:dbench.0 00010000:00000080:0.0:1715205775.884175:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c2276c0 x1798520455761024/t0(0) o37->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 448/440 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.884220:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2276c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+121:11754:x1798520455761024:12345-192.168.204.8@tcp:37:dbench.0 Request processed in 2153us (2226us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.884225:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 481 00000100:00100000:3.0:1715205775.885972:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.886038:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455761152 00000100:00100000:0.0:1715205775.886093:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1855 00000100:00100000:0.0:1715205775.886098:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+121:11754:x1798520455761152:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.886109:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.886126:0:14185:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1715205775.886158:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1f80/0xb608af430500740a lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236f7 expref: 121 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.886181:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205775.886190:0:14185:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205775.886198:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af4305007411 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b236fe expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.886361:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305007418 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.886389:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305007418 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.886409:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305007418 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.886428:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af430500741f lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.886433:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af430500741f lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.886439:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af430500741f lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715205775.886938:0:14185:0:(osp_object.c:1645:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x100010000:0x15da:0x0], index 1: 0 00010000:00010000:0.0:1715205775.887059:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007426 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.887064:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007426 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.887068:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007426 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.887083:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305007418 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.887087:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305007418 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.887090:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305007418 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.887093:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c0b40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.887095:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305007418 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.887098:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305007418 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.887101:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205775.887102:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.887104:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305007418 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.887106:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0b40/0xb608af4305007418 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715205775.887110:0:14185:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff8800a6a4df00 reply state ffff8800a7250000 transno 330712482599 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af430500741f lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.887123:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0000/0xb608af4305007411 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236fe expref: 123 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.887128:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007426 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236fe expref: 122 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.887133:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1012:0x0].0x0 (ffff880135bf2200) 00010000:00010000:0.0:1715205775.887134:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1715205775.887135:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099172f40, rc 0) 00010000:00000080:0.0:1715205775.887138:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6a4df00 x1798520455761152/t330712482599(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 656/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.887178:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+123:11754:x1798520455761152:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1080us (1207us total) trans 330712482599 rc 0/0 00000100:00100000:0.0:1715205775.887183:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1855 00010000:00010000:0.0:1715205775.888665:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af430500741f lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.888674:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af430500741f lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.888679:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af430500741f lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.888683:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009b8c0900 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.888685:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af430500741f lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.888690:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af430500741f lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.888699:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0xa992fa2d (ffff880135bf2c00) 00010000:00010000:0.0:1715205775.888701:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.888702:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af430500741f lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.888707:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0900/0xb608af430500741f lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.888860:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.888906:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455761216 00000100:00100000:0.0:1715205775.888932:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1856 00000100:00100000:0.0:1715205775.888937:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+122:11754:x1798520455761216:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.888950:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.888957:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305007434 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23705 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.888985:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af430500743b lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.888990:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af430500743b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.888994:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af430500743b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205775.889007:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205775.889013:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af430500743b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.889017:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af430500743b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.889026:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305007434 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23705 expref: 124 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.889034:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af430500743b lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23705 expref: 123 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.889038:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1012:0x0].0x0 (ffff880135bf2200) 00010000:00010000:0.0:1715205775.889039:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205775.889040:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099172d00, rc 0) 00010000:00000080:0.0:1715205775.889042:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6a4c280 x1798520455761216/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.889070:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+123:11754:x1798520455761216:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 134us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.889075:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1856 00000100:00100000:2.0:1715205775.890597:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.890654:0:19961:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455761280 00000100:00100000:0.0:1715205775.890685:0:19961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14689 00000100:00100000:0.0:1715205775.890690:0:19961:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c220e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+42:1830:x1798520455761280:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.890700:0:19961:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.890711:0:19961:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099170900/0xb608af4305007442 lrc: 2/0,0 mode: --/PR res: [0x15da:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2370c expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1715205775.890729:0:19961:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x15da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1715205775.890756:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205775.890758:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205775.890764:0:19961:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099170900/0xb608af4305007442 lrc: 3/0,0 mode: PR/PR res: [0x15da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2370c expref: 43 pid: 19961 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1715205775.890773:0:19961:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099170900/0xb608af4305007442 lrc: 3/0,0 mode: PR/PR res: [0x15da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2370c expref: 43 pid: 19961 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1715205775.890785:0:19961:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099170900, rc 0) 00000100:00100000:0.0:1715205775.890816:0:19961:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c220e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+43:1830:x1798520455761280:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 126us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.890821:0:19961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14689 00000100:00100000:3.0:1715205775.892578:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.892661:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455761408 00000100:00100000:0.0:1715205775.892713:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 482 00000100:00100000:0.0:1715205775.892719:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a49c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+123:11754:x1798520455761408:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.893005:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6a49c80 x1798520455761408/t330712482600(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.893061:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a49c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+124:11754:x1798520455761408:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 342us (486us total) trans 330712482600 rc 0/0 00000100:00100000:0.0:1715205775.893068:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 482 00000100:00100000:3.0:1715205775.894667:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.894855:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455761536 00000100:00100000:0.0:1715205775.894900:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1857 00000100:00100000:0.0:1715205775.894905:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+124:11754:x1798520455761536:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.894920:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.894933:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305007449 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23713 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.895002:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007450 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.895013:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af430500743b lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23705 expref: 125 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.895023:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007450 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.895048:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af430500743b lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23705 expref: 125 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.895057:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af430500743b lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23705 expref: 125 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.895066:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a66dd0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456031232:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205775.895121:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b9d1180 going to sleep for 6 seconds 00000100:00100000:0.0:1715205775.896452:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a66dd0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456031232:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205775.896471:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007450 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.896570:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.896649:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455761600 00010000:00010000:0.0:1715205775.896668:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af430500743b lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23705 expref: 126 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.896696:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4708 00000100:00100000:0.0:1715205775.896700:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+126:1831:x1798520455761600:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1715205775.896713:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.896716:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af430500743b lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23705 expref: 126 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.896724:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af430500743b lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23705 expref: 126 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.896737:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af430500743b lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23705 expref: 126 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.896795:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1012:0x0].0x0 (ffff880135bf2200) 00010000:00010000:0.0:1715205775.896798:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007450 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.896804:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007450 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.896809:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007450 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.896823:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205775.896855:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+125:1831:x1798520455761600:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 154us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.896861:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4708 00010000:00010000:2.0:1715205775.896905:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007450 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.896911:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007450 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205775.896923:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1012:0x0]: returning size 0 00010000:00010000:2.0:1715205775.897043:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305007449 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23713 expref: 126 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.897089:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007450 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23713 expref: 125 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.897098:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1012:0x0].0x0 (ffff880135bf2200) 00010000:00010000:2.0:1715205775.897100:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205775.897101:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099172ac0, rc 0) 00010000:00000080:2.0:1715205775.897105:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6a4f200 x1798520455761536/t330712482601(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.897140:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+125:11754:x1798520455761536:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2235us (2476us total) trans 330712482601 rc 0/0 00000100:00100000:2.0:1715205775.897145:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1857 00000100:00100000:3.0:1715205775.898485:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.898579:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455761664 00000100:00100000:2.0:1715205775.898636:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1858 00000100:00100000:2.0:1715205775.898641:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+125:11754:x1798520455761664:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.898655:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.898667:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af430500745e lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2371a expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.898702:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007465 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.898711:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007450 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23713 expref: 126 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.898716:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007465 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.898737:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007450 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23713 expref: 126 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.898763:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007450 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23713 expref: 126 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.898771:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c221300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456031296:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205775.898814:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31e40 going to sleep for 6 seconds 00000100:00100000:0.0:1715205775.899731:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c221300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456031296:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205775.899765:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007465 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.899911:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.899967:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455761728 00010000:00010000:0.0:1715205775.899994:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007450 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23713 expref: 127 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.900024:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4709 00000100:00100000:0.0:1715205775.900029:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b521d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+127:1830:x1798520455761728:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1715205775.900041:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.900046:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007450 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23713 expref: 127 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.900054:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007450 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23713 expref: 127 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.900071:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007450 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23713 expref: 127 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.900083:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1012:0x0].0x0 (ffff880135bf2200) 00010000:00010000:0.0:1715205775.900087:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007465 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.900094:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007465 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.900100:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007465 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.900126:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205775.900142:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007465 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.900149:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007465 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.900171:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b521d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+126:1830:x1798520455761728:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 141us (260us total) trans 0 rc 0/0 00000004:00200000:2.0:1715205775.900176:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1012:0x0]: returning size 0 00000100:00100000:0.0:1715205775.900177:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4709 00000004:00200000:2.0:1715205775.900178:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205775.900189:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007465 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.900197:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007465 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.900215:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af430500745e lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2371a expref: 126 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.900227:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007465 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2371a expref: 125 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.900233:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1012:0x0].0x0 (ffff880135bf2200) 00010000:00010000:2.0:1715205775.900235:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205775.900237:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedef40, rc 0) 00010000:00000080:2.0:1715205775.900240:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6a4da40 x1798520455761664/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.900265:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+125:11754:x1798520455761664:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1624us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.900271:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1858 00000100:00100000:3.0:1715205775.902004:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.902049:0:20898:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455761792 00000100:00100000:2.0:1715205775.902083:0:20898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14690 00000100:00100000:2.0:1715205775.902088:0:20898:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+43:11754:x1798520455761792:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.902099:0:20898:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.902112:0:20898:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eedd8c0/0xb608af430500746c lrc: 2/0,0 mode: --/PW res: [0x15da:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23721 expref: -99 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.902132:0:20898:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099170900/0xb608af4305007442 lrc: 2/0,0 mode: PR/PR res: [0x15da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2370c expref: 44 pid: 19961 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715205775.902137:0:20898:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715205775.902138:0:20898:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715205775.902140:0:20898:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eedd8c0/0xb608af430500746c lrc: 4/0,0 mode: --/PW res: [0x15da:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23721 expref: 44 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.902162:0:20898:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099170900/0xb608af4305007442 lrc: 3/0,0 mode: PR/PR res: [0x15da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2370c expref: 44 pid: 19961 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715205775.902171:0:20898:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099170900/0xb608af4305007442 lrc: 4/0,0 mode: PR/PR res: [0x15da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2370c expref: 44 pid: 19961 timeout: 3135 lvb_type: 1 00000100:00100000:2.0:1715205775.902180:0:20898:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2217c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20898:1798520456031360:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205775.902209:0:20898:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31c00 going to sleep for 6 seconds 00000100:00100000:3.0:1715205775.903698:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.903721:0:20898:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c2217c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20898:1798520456031360:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205775.903739:0:20898:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eedd8c0/0xb608af430500746c lrc: 3/0,0 mode: --/PW res: [0x15da:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23721 expref: 44 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.903766:0:20898:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedd8c0, rc 0) 00000100:00100000:0.0:1715205775.903777:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455761856 00000100:00100000:2.0:1715205775.903794:0:20898:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+45:11754:x1798520455761792:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1705us (1792us total) trans 0 rc 0/0 00010000:00010000:0.0:1715205775.903797:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099170900/0xb608af4305007442 lrc: 4/0,0 mode: PR/PR res: [0x15da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2370c expref: 45 pid: 19961 timeout: 3135 lvb_type: 1 00000100:00100000:2.0:1715205775.903801:0:20898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14690 00000100:00100000:0.0:1715205775.903818:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4710 00000100:00100000:0.0:1715205775.903822:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4b440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+44:1830:x1798520455761856:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1715205775.903829:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.903843:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099170900/0xb608af4305007442 lrc: 4/0,0 mode: PR/PR res: [0x15da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2370c expref: 44 pid: 19961 timeout: 3135 lvb_type: 1 00010000:00010000:0.0:1715205775.903851:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099170900/0xb608af4305007442 lrc: 3/0,0 mode: PR/PR res: [0x15da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2370c expref: 44 pid: 19961 timeout: 3135 lvb_type: 1 00010000:00010000:0.0:1715205775.903865:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099170900/0xb608af4305007442 lrc: 0/0,0 mode: --/PR res: [0x15da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2370c expref: 44 pid: 19961 timeout: 3135 lvb_type: 1 00010000:00010000:0.0:1715205775.903873:0:6662:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205775.903874:0:6662:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205775.903879:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eedd8c0/0xb608af430500746c lrc: 2/0,0 mode: PW/PW res: [0x15da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23721 expref: 43 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.903885:0:6662:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eedd8c0/0xb608af430500746c lrc: 3/0,0 mode: PW/PW res: [0x15da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23721 expref: 43 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.903902:0:6662:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009eedd8c0/0xb608af430500746c lrc: 3/0,0 mode: PW/PW res: [0x15da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23721 expref: 43 pid: 20898 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.903910:0:6662:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a66dd0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6662:1798520456031424:192.168.204.8@tcp:105: 00000100:00100000:0.0:1715205775.903930:0:6662:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b9d1a80 going to sleep for 6 seconds 00000100:00100000:0.0:1715205775.905393:0:6662:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a66dd0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6662:1798520456031424:192.168.204.8@tcp:105: 00010000:00010000:0.0:1715205775.905408:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205775.905429:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4b440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+43:1830:x1798520455761856:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 1606us (1732us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.905436:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4710 00000100:00100000:3.0:1715205775.906575:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.906641:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455761984 00000100:00100000:0.0:1715205775.906703:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 483 00000100:00100000:0.0:1715205775.906712:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+125:11754:x1798520455761984:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.906914:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6a4cc00 x1798520455761984/t330712482602(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.906952:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+126:11754:x1798520455761984:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 240us (378us total) trans 330712482602 rc 0/0 00000100:00100000:0.0:1715205775.906958:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 483 00000100:00100000:3.0:1715205775.908561:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.908639:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455762112 00000100:00100000:2.0:1715205775.908676:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1859 00000100:00100000:2.0:1715205775.908681:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a48980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+126:11754:x1798520455762112:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.908693:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.908706:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af4305007473 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23728 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.908769:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500747a lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.908779:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007465 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2371a expref: 127 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.908783:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500747a lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.908803:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007465 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2371a expref: 127 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.908812:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007465 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2371a expref: 127 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.908818:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2217c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456031488:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205775.908851:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31c00 going to sleep for 6 seconds 00000100:00100000:2.0:1715205775.910100:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c2217c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456031488:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205775.910104:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:2.0:1715205775.910117:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500747a lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.910143:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455762176 00010000:00010000:0.0:1715205775.910158:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007465 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2371a expref: 128 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.910181:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4711 00000100:00100000:0.0:1715205775.910185:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:1830:x1798520455762176:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205775.910192:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.910195:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007465 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2371a expref: 128 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.910202:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007465 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2371a expref: 128 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.910214:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007465 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2371a expref: 128 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.910223:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1012:0x0].0x0 (ffff880135bf2200) 00010000:00010000:0.0:1715205775.910226:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500747a lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.910231:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500747a lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.910236:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500747a lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.910250:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205775.910259:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500747a lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.910265:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500747a lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.910276:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+127:1830:x1798520455762176:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 91us (173us total) trans 0 rc 0/0 00000004:00200000:2.0:1715205775.910277:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1012:0x0]: returning size 4096 00000100:00100000:0.0:1715205775.910282:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4711 00010000:00010000:2.0:1715205775.910364:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af4305007473 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23728 expref: 128 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.910383:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500747a lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23728 expref: 127 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.910389:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1012:0x0].0x0 (ffff880135bf2200) 00010000:00010000:2.0:1715205775.910391:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205775.910393:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eeddb00, rc 0) 00010000:00000080:2.0:1715205775.910397:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6a48980 x1798520455762112/t330712482603(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.910439:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a48980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+127:11754:x1798520455762112:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1757us (1880us total) trans 330712482603 rc 0/0 00000100:00100000:2.0:1715205775.910445:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1859 00000100:00100000:3.0:1715205775.912486:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.912552:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455762240 00000100:00100000:2.0:1715205775.912582:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1860 00000100:00100000:2.0:1715205775.912585:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+127:11754:x1798520455762240:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.912596:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.912604:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305007488 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2372f expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.912649:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af430500748f lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.912656:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500747a lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23728 expref: 128 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.912661:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af430500748f lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.912678:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500747a lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23728 expref: 128 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.912684:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500747a lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23728 expref: 128 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.912691:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2217c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456031552:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205775.912728:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31c00 going to sleep for 6 seconds 00000100:00100000:2.0:1715205775.913758:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c2217c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456031552:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205775.913773:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af430500748f lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.914044:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.914098:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455762304 00010000:00010000:0.0:1715205775.914115:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500747a lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23728 expref: 129 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.914147:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4712 00000100:00100000:0.0:1715205775.914151:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4ed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+129:1831:x1798520455762304:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1715205775.914159:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.914163:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500747a lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23728 expref: 129 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.914171:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500747a lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23728 expref: 129 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.914184:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500747a lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23728 expref: 129 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.914198:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1012:0x0].0x0 (ffff880135bf2200) 00010000:00010000:0.0:1715205775.914200:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af430500748f lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.914206:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af430500748f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.914210:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af430500748f lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.914234:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205775.914257:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4ed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:1831:x1798520455762304:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 106us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.914262:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4712 00010000:00010000:0.0:1715205775.914286:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af430500748f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.914291:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af430500748f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205775.914315:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1012:0x0]: returning size 4096 00000004:00200000:0.0:1715205775.914318:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205775.914328:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af430500748f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.914335:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af430500748f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.914349:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305007488 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2372f expref: 128 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.914359:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af430500748f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2372f expref: 127 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.914364:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1012:0x0].0x0 (ffff880135bf2200) 00010000:00010000:0.0:1715205775.914365:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205775.914367:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eede640, rc 0) 00010000:00000080:0.0:1715205775.914370:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6a4e3c0 x1798520455762240/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.914390:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+127:11754:x1798520455762240:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1804us (1907us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.914394:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1860 00000100:00100000:3.0:1715205775.915437:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.915509:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455762368 00000100:00100000:0.0:1715205775.915541:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1861 00000100:00100000:0.0:1715205775.915545:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+127:11754:x1798520455762368:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.915554:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.915563:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af4305007496 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23736 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.915592:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af430500749d lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.915600:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af430500749d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.915606:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af430500749d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.915639:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050074a4 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.915645:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050074a4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.915650:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050074a4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.915701:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af430500749d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.915706:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af430500749d lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.915711:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af430500749d lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.915715:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099172640 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.915718:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af430500749d lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.915724:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af430500749d lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.915731:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205775.915733:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.915735:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af430500749d lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.915755:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af430500749d lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.915763:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050074a4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.915767:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050074a4 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.915771:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050074a4 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.915774:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099173600 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.915776:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050074a4 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.915779:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050074a4 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.915783:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0xa992fa36 (ffff880135bf2300) 00010000:00010000:0.0:1715205775.915785:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.915785:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050074a4 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.915789:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050074a4 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.915812:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af4305007496 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23736 expref: 128 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.915821:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af4305007496 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23736 expref: 128 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.915826:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800991721c0, rc 0) 00010000:00000080:0.0:1715205775.915828:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6a4d0c0 x1798520455762368/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.915860:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+127:11754:x1798520455762368:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 314us (425us total) trans 0 rc 301/301 00000100:00100000:0.0:1715205775.915865:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1861 00000100:00100000:3.0:1715205775.918293:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.918315:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455762432 00000100:00100000:0.0:1715205775.918423:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1862 00000100:00100000:0.0:1715205775.918428:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a484c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+127:11754:x1798520455762432:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.918440:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.918675:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170000/0xb608af43050074ab lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2373d expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.918706:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099170000/0xb608af43050074ab lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2373d expref: 128 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.918716:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170000/0xb608af43050074ab lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2373d expref: 128 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.918722:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205775.918725:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.918727:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099170000, rc 0) 00010000:00000080:0.0:1715205775.918730:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6a484c0 x1798520455762432/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 328/344 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.918790:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a484c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:11754:x1798520455762432:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 361us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.918796:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1862 00000100:00100000:3.0:1715205775.920172:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.920210:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455762496 00000100:00100000:0.0:1715205775.920242:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 484 00000100:00100000:0.0:1715205775.920245:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091812050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:11754:x1798520455762496:12345-192.168.204.8@tcp:37:dbench.0 00010000:00000080:0.0:1715205775.922273:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880091812050 x1798520455762496/t0(0) o37->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 448/440 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.922311:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091812050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:11754:x1798520455762496:12345-192.168.204.8@tcp:37:dbench.0 Request processed in 2064us (2140us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.922318:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 484 00000100:00100000:3.0:1715205775.923883:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.924422:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455762624 00000100:00100000:0.0:1715205775.924462:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1863 00000100:00100000:0.0:1715205775.924466:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a497c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:11754:x1798520455762624:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.924480:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.924483:0:14185:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1715205775.924501:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170000/0xb608af43050074ab lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2373d expref: 128 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.924521:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205775.924525:0:14185:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205775.924533:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af43050074b2 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23744 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.924658:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af43050074b9 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.924669:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af43050074b9 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.924676:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af43050074b9 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.924687:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af43050074c0 lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.924691:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af43050074c0 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.924696:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af43050074c0 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715205775.924983:0:14185:0:(osp_object.c:1645:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x100000000:0x17ba:0x0], index 0: 0 00010000:00010000:0.0:1715205775.925092:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050074c7 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.925101:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050074c7 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.925105:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050074c7 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.925124:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af43050074b9 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.925129:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af43050074b9 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.925134:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af43050074b9 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.925138:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099170fc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.925140:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af43050074b9 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.925145:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af43050074b9 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.925150:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205775.925152:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.925153:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af43050074b9 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.925156:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af43050074b9 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715205775.925162:0:14185:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff8800a6a497c0 reply state ffff8800a7256000 transno 330712482604 ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af43050074c0 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.925178:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af43050074b2 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23744 expref: 130 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.925185:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050074c7 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23744 expref: 129 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.925189:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1013:0x0].0x0 (ffff880135bf2600) 00010000:00010000:0.0:1715205775.925191:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1715205775.925192:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099173600, rc 0) 00010000:00000080:0.0:1715205775.925195:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6a497c0 x1798520455762624/t330712482604(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 656/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.925245:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a497c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+130:11754:x1798520455762624:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 779us (1366us total) trans 330712482604 rc 0/0 00000100:00100000:0.0:1715205775.925251:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1863 00010000:00010000:2.0:1715205775.926134:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af43050074c0 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.926142:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af43050074c0 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.926147:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af43050074c0 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.926150:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800991721c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.926152:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af43050074c0 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.926156:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af43050074c0 lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.926162:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0xa992fa36 (ffff880135bf2f00) 00010000:00010000:2.0:1715205775.926163:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.926165:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af43050074c0 lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.926168:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af43050074c0 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.926376:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.926438:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455762688 00000100:00100000:0.0:1715205775.926467:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1864 00000100:00100000:0.0:1715205775.926472:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+129:11754:x1798520455762688:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.926481:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.926487:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af43050074d5 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2374b expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.926719:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af43050074dc lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.926726:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af43050074dc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.926732:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af43050074dc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205775.926758:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205775.926765:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af43050074dc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.926771:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af43050074dc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.926786:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af43050074d5 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2374b expref: 131 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.926795:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af43050074dc lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2374b expref: 130 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.926801:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1013:0x0].0x0 (ffff880135bf2600) 00010000:00010000:0.0:1715205775.926802:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205775.926803:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099170900, rc 0) 00010000:00000080:0.0:1715205775.926806:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6a4f6c0 x1798520455762688/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.926835:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+130:11754:x1798520455762688:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 363us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.926840:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1864 00000100:00100000:3.0:1715205775.927912:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.927958:0:20898:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455762752 00000100:00100000:2.0:1715205775.927984:0:20898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14691 00000100:00100000:2.0:1715205775.927987:0:20898:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a49300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+39:1830:x1798520455762752:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.927994:0:20898:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.928004:0:20898:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eedfcc0/0xb608af43050074e3 lrc: 2/0,0 mode: --/PR res: [0x17ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23752 expref: -99 pid: 20898 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1715205775.928018:0:20898:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x17ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1715205775.928027:0:20898:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715205775.928028:0:20898:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715205775.928033:0:20898:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eedfcc0/0xb608af43050074e3 lrc: 3/0,0 mode: PR/PR res: [0x17ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23752 expref: 40 pid: 20898 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715205775.928042:0:20898:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009eedfcc0/0xb608af43050074e3 lrc: 3/0,0 mode: PR/PR res: [0x17ba:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23752 expref: 40 pid: 20898 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715205775.928048:0:20898:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedfcc0, rc 0) 00000100:00100000:2.0:1715205775.928081:0:20898:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a49300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+40:1830:x1798520455762752:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 93us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.928087:0:20898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14691 00000100:00100000:3.0:1715205775.929173:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.929199:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455762880 00000100:00100000:0.0:1715205775.929231:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 485 00000100:00100000:0.0:1715205775.929235:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+130:11754:x1798520455762880:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.929415:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6a4aac0 x1798520455762880/t330712482605(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.929456:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+131:11754:x1798520455762880:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 219us (284us total) trans 330712482605 rc 0/0 00000100:00100000:0.0:1715205775.929461:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 485 00000100:00100000:3.0:1715205775.931283:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.931349:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455763008 00000100:00100000:0.0:1715205775.931383:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1865 00000100:00100000:0.0:1715205775.931388:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+131:11754:x1798520455763008:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205775.931402:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205775.931415:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af43050074ea lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23759 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.931472:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af43050074f1 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.931483:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af43050074dc lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2374b expref: 132 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.931487:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af43050074f1 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.931509:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af43050074dc lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2374b expref: 132 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.931518:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af43050074dc lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2374b expref: 132 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.931528:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a66dd0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456031616:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205775.931560:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a5f26cc0 going to sleep for 6 seconds 00000100:00100000:3.0:1715205775.932571:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.932632:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a66dd0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456031616:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205775.932637:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455763072 00010000:00010000:0.0:1715205775.932646:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af43050074f1 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.932651:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af43050074dc lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2374b expref: 133 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.932668:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4713 00000100:00100000:2.0:1715205775.932671:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a49c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+133:1830:x1798520455763072:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1715205775.932679:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205775.932682:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af43050074dc lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2374b expref: 133 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.932716:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af43050074dc lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2374b expref: 133 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.932730:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af43050074dc lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2374b expref: 133 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.932762:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1013:0x0].0x0 (ffff880135bf2600) 00010000:00010000:2.0:1715205775.932766:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af43050074f1 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.932771:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af43050074f1 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.932775:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af43050074f1 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.932796:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205775.932825:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af43050074f1 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.932833:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af43050074f1 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205775.932845:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1013:0x0]: returning size 0 00000100:00100000:2.0:1715205775.932886:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a49c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+132:1830:x1798520455763072:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 214us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.932892:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4713 00010000:00010000:1.0:1715205775.932932:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af43050074ea lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23759 expref: 133 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.932943:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af43050074f1 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23759 expref: 132 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.932946:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1013:0x0].0x0 (ffff880135bf2600) 00010000:00010000:1.0:1715205775.932948:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205775.932949:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099172d00, rc 0) 00010000:00000080:1.0:1715205775.932951:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6a4d580 x1798520455763008/t330712482606(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.932970:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+132:11754:x1798520455763008:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1582us (1691us total) trans 330712482606 rc 0/0 00000100:00100000:1.0:1715205775.932975:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1865 00000100:00100000:3.0:1715205775.933886:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.933927:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455763136 00000100:00100000:1.0:1715205775.933957:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1866 00000100:00100000:1.0:1715205775.933962:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+132:11754:x1798520455763136:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.933974:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.933982:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050074ff lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23760 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.934010:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af4305007506 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.934019:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af43050074f1 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23759 expref: 133 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.934023:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af4305007506 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.934042:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af43050074f1 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23759 expref: 133 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.934049:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af43050074f1 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23759 expref: 133 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.934058:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456031680:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.934086:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b48b2840 going to sleep for 6 seconds 00000100:00100000:1.0:1715205775.935121:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456031680:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205775.935158:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af4305007506 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.935237:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.935327:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455763200 00010000:00010000:2.0:1715205775.935342:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af43050074f1 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23759 expref: 134 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205775.935409:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4714 00000100:00100000:2.0:1715205775.935413:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+134:1830:x1798520455763200:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1715205775.935421:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205775.935425:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af43050074f1 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23759 expref: 134 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.935432:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af43050074f1 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23759 expref: 134 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.935443:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af43050074f1 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23759 expref: 134 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205775.935452:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1013:0x0].0x0 (ffff880135bf2600) 00010000:00010000:2.0:1715205775.935454:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af4305007506 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.935459:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af4305007506 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.935463:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af4305007506 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.935649:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205775.935808:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af4305007506 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.935814:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af4305007506 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205775.935838:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1013:0x0]: returning size 0 00000004:00200000:1.0:1715205775.935841:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205775.935850:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af4305007506 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.935857:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af4305007506 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.935872:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050074ff lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23760 expref: 134 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.935882:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af4305007506 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23760 expref: 133 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.935886:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1013:0x0].0x0 (ffff880135bf2600) 00010000:00010000:1.0:1715205775.935888:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205775.935889:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9a1c0, rc 0) 00010000:00000080:1.0:1715205775.935893:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6a4cc00 x1798520455763136/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205775.935924:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+133:1830:x1798520455763200:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 510us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.935930:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4714 00000100:00100000:1.0:1715205775.936201:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+132:11754:x1798520455763136:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2238us (2315us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.936206:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1866 00000100:00100000:3.0:1715205775.937784:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.937848:0:20898:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455763264 00000100:00100000:2.0:1715205775.937881:0:20898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14692 00000100:00100000:2.0:1715205775.937886:0:20898:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+40:11754:x1798520455763264:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.937897:0:20898:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.937911:0:20898:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009eeded00/0xb608af430500750d lrc: 2/0,0 mode: --/PW res: [0x17ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23767 expref: -99 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.937934:0:20898:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eedfcc0/0xb608af43050074e3 lrc: 2/0,0 mode: PR/PR res: [0x17ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23752 expref: 41 pid: 20898 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715205775.937940:0:20898:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715205775.937942:0:20898:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715205775.937944:0:20898:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eeded00/0xb608af430500750d lrc: 4/0,0 mode: --/PW res: [0x17ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23767 expref: 41 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.937965:0:20898:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009eedfcc0/0xb608af43050074e3 lrc: 3/0,0 mode: PR/PR res: [0x17ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23752 expref: 41 pid: 20898 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715205775.937974:0:20898:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009eedfcc0/0xb608af43050074e3 lrc: 4/0,0 mode: PR/PR res: [0x17ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23752 expref: 41 pid: 20898 timeout: 3135 lvb_type: 1 00000100:00100000:2.0:1715205775.937982:0:20898:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2217c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20898:1798520456031744:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205775.938021:0:20898:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31c00 going to sleep for 6 seconds 00000100:00100000:3.0:1715205775.939058:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205775.939074:0:20898:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c2217c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20898:1798520456031744:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205775.939082:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455763328 00010000:00010000:2.0:1715205775.939091:0:20898:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009eeded00/0xb608af430500750d lrc: 3/0,0 mode: --/PW res: [0x17ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23767 expref: 42 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.939095:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009eedfcc0/0xb608af43050074e3 lrc: 4/0,0 mode: PR/PR res: [0x17ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23752 expref: 42 pid: 20898 timeout: 3135 lvb_type: 1 00010000:00010000:2.0:1715205775.939101:0:20898:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eeded00, rc 0) 00000100:00100000:2.0:1715205775.939122:0:20898:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+42:11754:x1798520455763264:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1236us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205775.939128:0:20898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14692 00000100:00100000:0.0:1715205775.939235:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4715 00000100:00100000:0.0:1715205775.939239:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+41:1831:x1798520455763328:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205775.939246:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.939260:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009eedfcc0/0xb608af43050074e3 lrc: 4/0,0 mode: PR/PR res: [0x17ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23752 expref: 41 pid: 20898 timeout: 3135 lvb_type: 1 00010000:00010000:0.0:1715205775.939268:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009eedfcc0/0xb608af43050074e3 lrc: 3/0,0 mode: PR/PR res: [0x17ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23752 expref: 41 pid: 20898 timeout: 3135 lvb_type: 1 00010000:00010000:0.0:1715205775.939281:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009eedfcc0/0xb608af43050074e3 lrc: 0/0,0 mode: --/PR res: [0x17ba:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23752 expref: 41 pid: 20898 timeout: 3135 lvb_type: 1 00010000:00010000:0.0:1715205775.939288:0:8315:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205775.939288:0:8315:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205775.939292:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009eeded00/0xb608af430500750d lrc: 2/0,0 mode: PW/PW res: [0x17ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23767 expref: 40 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.939296:0:8315:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009eeded00/0xb608af430500750d lrc: 3/0,0 mode: PW/PW res: [0x17ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23767 expref: 40 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.939309:0:8315:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009eeded00/0xb608af430500750d lrc: 3/0,0 mode: PW/PW res: [0x17ba:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23767 expref: 40 pid: 20898 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.939315:0:8315:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a66dd0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8315:1798520456031808:192.168.204.8@tcp:105: 00000100:00100000:0.0:1715205775.939349:0:8315:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a5f26cc0 going to sleep for 6 seconds 00000100:00100000:0.0:1715205775.940587:0:8315:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a66dd0c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8315:1798520456031808:192.168.204.8@tcp:105: 00010000:00010000:0.0:1715205775.940599:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205775.940643:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+40:1831:x1798520455763328:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 1403us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.940650:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4715 00000100:00100000:3.0:1715205775.941174:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.941230:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455763456 00000100:00100000:0.0:1715205775.941262:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 486 00000100:00100000:0.0:1715205775.941266:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+132:11754:x1798520455763456:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.941444:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147a600 x1798520455763456/t330712482607(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.941481:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+133:11754:x1798520455763456:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 215us (307us total) trans 330712482607 rc 0/0 00000100:00100000:0.0:1715205775.941487:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 486 00000100:00100000:3.0:1715205775.943238:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.943299:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455763584 00000100:00100000:1.0:1715205775.943475:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1867 00000100:00100000:1.0:1715205775.943479:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131478980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+133:11754:x1798520455763584:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.943490:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.943502:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305007514 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2376e expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.943555:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500751b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.943565:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af4305007506 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23760 expref: 134 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.943570:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500751b lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.943592:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af4305007506 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23760 expref: 134 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.943601:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af4305007506 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23760 expref: 134 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.943609:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456031872:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.943688:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b48b2840 going to sleep for 6 seconds 00000100:00100000:1.0:1715205775.944715:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456031872:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205775.944728:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500751b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.945352:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.945438:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455763648 00010000:00010000:0.0:1715205775.945454:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af4305007506 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23760 expref: 135 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.945481:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4716 00000100:00100000:0.0:1715205775.945485:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b24f5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+135:1830:x1798520455763648:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1715205775.945493:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.945497:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af4305007506 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23760 expref: 135 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.945504:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af4305007506 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23760 expref: 135 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.945521:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af4305007506 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23760 expref: 135 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.945532:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1013:0x0].0x0 (ffff880135bf2600) 00010000:00010000:0.0:1715205775.945534:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500751b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.945540:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500751b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.945544:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500751b lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.945562:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205775.945586:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b24f5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+134:1830:x1798520455763648:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 101us (239us total) trans 0 rc 0/0 00010000:00010000:1.0:1715205775.945590:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500751b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.945591:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4716 00010000:00010000:1.0:1715205775.945597:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500751b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205775.945610:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1013:0x0]: returning size 4096 00010000:00010000:1.0:1715205775.945728:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305007514 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2376e expref: 135 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.945739:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500751b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2376e expref: 134 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.945756:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1013:0x0].0x0 (ffff880135bf2600) 00010000:00010000:1.0:1715205775.945758:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205775.945759:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd986c0, rc 0) 00010000:00000080:1.0:1715205775.945763:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880131478980 x1798520455763584/t330712482608(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.945784:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131478980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+134:11754:x1798520455763584:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2305us (2549us total) trans 330712482608 rc 0/0 00000100:00100000:1.0:1715205775.945788:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1867 00000100:00100000:3.0:1715205775.947032:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.947115:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455763712 00000100:00100000:1.0:1715205775.947151:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1868 00000100:00100000:1.0:1715205775.947155:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+134:11754:x1798520455763712:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.947171:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.947186:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af4305007529 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23775 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.947231:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007530 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.947244:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500751b lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2376e expref: 135 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.947250:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007530 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.947278:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500751b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2376e expref: 135 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.947286:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500751b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2376e expref: 135 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.947294:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456031936:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.947339:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b48b2840 going to sleep for 6 seconds 00000100:00100000:1.0:1715205775.949030:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456031936:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205775.949045:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007530 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.949291:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.949352:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455763776 00010000:00010000:0.0:1715205775.949373:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500751b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2376e expref: 136 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.949408:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4717 00000100:00100000:0.0:1715205775.949413:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+136:1831:x1798520455763776:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1715205775.949424:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.949428:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500751b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2376e expref: 136 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.949441:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500751b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2376e expref: 136 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.949458:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500751b lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2376e expref: 136 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.949471:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1013:0x0].0x0 (ffff880135bf2600) 00010000:00010000:0.0:1715205775.949475:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007530 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.949482:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007530 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.949488:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007530 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.949513:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205775.949522:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007530 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.949529:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007530 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.949544:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+135:1831:x1798520455763776:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 131us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.949551:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4717 00000004:00200000:1.0:1715205775.949568:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1013:0x0]: returning size 4096 00000004:00200000:1.0:1715205775.949572:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205775.949585:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007530 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.949593:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007530 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.949611:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af4305007529 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23775 expref: 135 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.949643:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007530 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23775 expref: 134 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.949648:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1013:0x0].0x0 (ffff880135bf2600) 00010000:00010000:1.0:1715205775.949651:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205775.949652:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9af40, rc 0) 00010000:00000080:1.0:1715205775.949657:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147b900 x1798520455763712/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.949687:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+134:11754:x1798520455763712:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2531us (2657us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.949693:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1868 00000100:00100000:3.0:1715205775.950801:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.950840:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455763840 00000100:00100000:1.0:1715205775.950937:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1869 00000100:00100000:1.0:1715205775.950941:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+134:11754:x1798520455763840:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.950954:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.950964:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007537 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2377c expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.950998:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af430500753e lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.951006:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af430500753e lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.951013:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af430500753e lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.951023:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007545 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xa053fa7a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.951028:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007545 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.951034:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007545 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.951104:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af430500753e lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.951109:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af430500753e lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.951114:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af430500753e lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.951119:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd9b840 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.951123:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af430500753e lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.951129:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af430500753e lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.951134:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.951136:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.951138:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af430500753e lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.951142:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af430500753e lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.951150:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007545 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.951155:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007545 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.951159:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007545 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.951164:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd9aac0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.951165:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007545 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.951169:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007545 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.951174:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0xa053fa7a (ffff880129f26300) 00010000:00010000:1.0:1715205775.951177:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.951178:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007545 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.951183:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007545 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.951207:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007537 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2377c expref: 135 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.951212:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007537 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2377c expref: 135 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.951218:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd99f80, rc 0) 00010000:00000080:1.0:1715205775.951221:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147e880 x1798520455763840/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.951258:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+134:11754:x1798520455763840:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 316us (459us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205775.951263:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1869 00000100:00100000:3.0:1715205775.952294:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.952344:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455763904 00000100:00100000:1.0:1715205775.952370:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1870 00000100:00100000:1.0:1715205775.952374:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+134:11754:x1798520455763904:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.952384:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.952392:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af430500754c lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23783 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.952408:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af430500754c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23783 expref: 135 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.952421:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af430500754c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23783 expref: 135 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.952426:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.952429:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.952430:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9b600, rc 0) 00010000:00000080:1.0:1715205775.952433:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880131478000 x1798520455763904/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 328/344 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.952463:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+135:11754:x1798520455763904:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 88us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.952468:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1870 00000100:00100000:3.0:1715205775.954084:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.954153:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455763968 00000100:00100000:0.0:1715205775.954187:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 487 00000100:00100000:0.0:1715205775.954191:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801314784c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+135:11754:x1798520455763968:12345-192.168.204.8@tcp:37:dbench.0 00010000:00000080:0.0:1715205775.956296:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801314784c0 x1798520455763968/t0(0) o37->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 448/440 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.956347:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801314784c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+135:11754:x1798520455763968:12345-192.168.204.8@tcp:37:dbench.0 Request processed in 2155us (2265us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.956357:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 487 00000100:00100000:3.0:1715205775.957880:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.957942:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455764096 00000100:00100000:1.0:1715205775.957989:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1871 00000100:00100000:1.0:1715205775.957995:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+135:11754:x1798520455764096:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.958012:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.958031:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af4305007553 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2378a expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.958130:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af430500755a lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.958142:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af430500755a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.958151:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af430500755a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.958175:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007561 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xa053fa7a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.958180:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007561 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.958186:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007561 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.958223:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af430500755a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.958229:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af430500755a lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.958234:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af430500755a lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.958240:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd9a640 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.958243:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af430500755a lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.958249:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af430500755a lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.958258:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.958260:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.958264:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af430500755a lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.958271:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af430500755a lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.958282:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007561 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.958287:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007561 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.958292:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007561 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.958296:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd9a880 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.958298:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007561 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.958302:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007561 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.958308:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0xa053fa7a (ffff880129f26200) 00010000:00010000:1.0:1715205775.958310:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.958311:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007561 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.958316:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007561 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.958338:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af4305007553 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2378a expref: 136 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.958349:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af4305007553 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2378a expref: 136 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.958356:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9b3c0, rc 0) 00010000:00000080:1.0:1715205775.958361:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147d580 x1798520455764096/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 656/600 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.958407:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+135:11754:x1798520455764096:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 412us (530us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205775.958413:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1871 00000100:00100000:3.0:1715205775.959854:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.959925:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455764224 00000100:00100000:0.0:1715205775.959963:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 488 00000100:00100000:0.0:1715205775.959967:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+135:11754:x1798520455764224:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.960117:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147af80 x1798520455764224/t330712482609(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.960153:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+136:11754:x1798520455764224:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 186us (300us total) trans 330712482609 rc 0/0 00000100:00100000:0.0:1715205775.960160:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 488 00000100:00100000:3.0:1715205775.961409:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.961473:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455764352 00000100:00100000:0.0:1715205775.961495:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 489 00000100:00100000:0.0:1715205775.961497:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+136:11754:x1798520455764352:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.961610:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147d0c0 x1798520455764352/t330712482610(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.961665:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+137:11754:x1798520455764352:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 167us (258us total) trans 330712482610 rc 0/0 00000100:00100000:0.0:1715205775.961669:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 489 00000100:00100000:3.0:1715205775.963231:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.963270:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455764480 00000100:00100000:0.0:1715205775.963309:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 490 00000100:00100000:0.0:1715205775.963314:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091810850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+137:11754:x1798520455764480:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.963483:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880091810850 x1798520455764480/t330712482611(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.963530:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091810850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+138:11754:x1798520455764480:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 215us (303us total) trans 330712482611 rc 0/0 00000100:00100000:0.0:1715205775.963536:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 490 00000100:00100000:3.0:1715205775.964538:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.964555:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455764608 00000100:00100000:0.0:1715205775.964580:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 491 00000100:00100000:0.0:1715205775.964584:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+138:11754:x1798520455764608:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.964675:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147c740 x1798520455764608/t330712482612(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.964710:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+139:11754:x1798520455764608:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 126us (172us total) trans 330712482612 rc 0/0 00000100:00100000:0.0:1715205775.964716:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 491 00000100:00100000:3.0:1715205775.965509:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.965668:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455764736 00000100:00100000:0.0:1715205775.965692:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 492 00000100:00100000:0.0:1715205775.965696:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+139:11754:x1798520455764736:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.965802:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147a140 x1798520455764736/t330712482613(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.965840:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+140:11754:x1798520455764736:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 143us (331us total) trans 330712482613 rc 0/0 00000100:00100000:0.0:1715205775.965846:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 492 00000100:00100000:3.0:1715205775.966521:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.966555:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455764864 00000100:00100000:0.0:1715205775.966582:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 493 00000100:00100000:0.0:1715205775.966586:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+140:11754:x1798520455764864:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.966702:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147df00 x1798520455764864/t330712482614(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.966734:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+141:11754:x1798520455764864:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 147us (214us total) trans 330712482614 rc 0/0 00000100:00100000:0.0:1715205775.966804:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 493 00000100:00100000:3.0:1715205775.967767:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.967830:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455764992 00000100:00100000:0.0:1715205775.967854:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 494 00000100:00100000:0.0:1715205775.967857:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131479300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+141:11754:x1798520455764992:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.967960:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880131479300 x1798520455764992/t330712482615(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.967993:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131479300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+142:11754:x1798520455764992:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 135us (229us total) trans 330712482615 rc 0/0 00000100:00100000:0.0:1715205775.967999:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 494 00000100:00100000:3.0:1715205775.968780:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.968911:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455765120 00000100:00100000:0.0:1715205775.968942:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 495 00000100:00100000:0.0:1715205775.968946:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+142:11754:x1798520455765120:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.969048:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147a600 x1798520455765120/t330712482616(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.969085:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+143:11754:x1798520455765120:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 138us (306us total) trans 330712482616 rc 0/0 00000100:00100000:0.0:1715205775.969091:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 495 00000100:00100000:3.0:1715205775.969864:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.970081:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455765248 00000100:00100000:0.0:1715205775.970111:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 496 00000100:00100000:0.0:1715205775.970115:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c05850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+143:11754:x1798520455765248:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.970210:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880093c05850 x1798520455765248/t330712482617(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.970248:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c05850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+144:11754:x1798520455765248:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 132us (385us total) trans 330712482617 rc 0/0 00000100:00100000:0.0:1715205775.970255:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 496 00000100:00100000:3.0:1715205775.971084:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.971106:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455765376 00000100:00100000:0.0:1715205775.971129:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 497 00000100:00100000:0.0:1715205775.971132:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801314784c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+144:11754:x1798520455765376:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.971219:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801314784c0 x1798520455765376/t330712482618(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.971254:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801314784c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+145:11754:x1798520455765376:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 121us (172us total) trans 330712482618 rc 0/0 00000100:00100000:0.0:1715205775.971260:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 497 00000100:00100000:3.0:1715205775.972158:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.972203:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455765504 00000100:00100000:0.0:1715205775.972245:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 498 00000100:00100000:0.0:1715205775.972251:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+145:11754:x1798520455765504:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.972418:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147af80 x1798520455765504/t330712482619(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.972464:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+146:11754:x1798520455765504:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 213us (307us total) trans 330712482619 rc 0/0 00000100:00100000:0.0:1715205775.972470:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 498 00000100:00100000:3.0:1715205775.973282:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.973322:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455765632 00000100:00100000:1.0:1715205775.973354:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 499 00000100:00100000:1.0:1715205775.973359:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+146:11754:x1798520455765632:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205775.973468:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147d0c0 x1798520455765632/t330712482620(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.973512:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+147:11754:x1798520455765632:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 152us (231us total) trans 330712482620 rc 0/0 00000100:00100000:1.0:1715205775.973518:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 499 00000100:00100000:3.0:1715205775.974251:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.974337:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455765760 00000100:00100000:1.0:1715205775.974375:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 500 00000100:00100000:1.0:1715205775.974380:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+147:11754:x1798520455765760:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205775.974564:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147bdc0 x1798520455765760/t330712482621(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.974757:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+148:11754:x1798520455765760:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 377us (508us total) trans 330712482621 rc 0/0 00000100:00100000:1.0:1715205775.974764:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 500 00000100:00100000:3.0:1715205775.976009:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.976079:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455765888 00000100:00100000:1.0:1715205775.976099:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 501 00000100:00100000:1.0:1715205775.976102:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+148:11754:x1798520455765888:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205775.976204:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147c740 x1798520455765888/t330712482622(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.976239:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+149:11754:x1798520455765888:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 136us (231us total) trans 330712482622 rc 0/0 00000100:00100000:1.0:1715205775.976245:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 501 00000100:00100000:3.0:1715205775.977533:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.977637:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455766016 00000100:00100000:1.0:1715205775.977669:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1872 00000100:00100000:1.0:1715205775.977673:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+149:11754:x1798520455766016:12345-192.168.204.8@tcp:36:dbench.0 00010000:00010000:1.0:1715205775.977698:0:14185:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1715205775.977715:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af430500748f lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2372f expref: 149 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.977729:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007426 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236fe expref: 148 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.977738:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1012:0x0].0x0 (ffff880135bf2200) 00010000:00010000:1.0:1715205775.977760:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af430500754c lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23783 expref: 147 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.977767:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.977769:0:14185:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205775.977786:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007568 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.977796:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007568 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.977803:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007568 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.977813:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af430500756f lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.977818:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af430500756f lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.977822:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af430500756f lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.977899:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007576 lrc: 3/0,1 mode: --/EX res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.977905:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007576 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.977910:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007576 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1715205775.978186:0:14185:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x136:0x0].66, 64 off12416 00010000:00010000:1.0:1715205775.978307:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af430500757d lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.978313:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af430500757d lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.978320:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af430500757d lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.978326:0:14185:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af430500757d lrc: 4/0,1 mode: PW/PW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.978330:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af430500757d lrc: 4/0,1 mode: PW/PW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.978335:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af430500757d lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.978358:0:14185:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1715205775.978370:0:14185:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88013147a140 reply state ffff8800a16ba000 transno 330712482623 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007576 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.978393:0:6569:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715205775.978398:0:6569:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af430500757d lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.978401:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007568 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.978405:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007568 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.978405:0:6569:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd98fc0 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:2.0:1715205775.978408:0:6569:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af430500757d lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.978410:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007568 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.978413:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd99200 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.978414:0:6569:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af430500757d lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.978415:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007568 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.978421:0:6569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1012:0x0].0x0 (ffff880129f26500) 00010000:00010000:1.0:1715205775.978423:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007568 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.978423:0:6569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715205775.978425:0:6569:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af430500757d lrc: 1/0,0 mode: --/PW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.978429:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205775.978429:0:6569:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af430500757d lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.978430:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.978431:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007568 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.978435:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007568 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715205775.978441:0:14185:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88013147a140 reply state ffff8800a16ba000 transno 330712482623 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af430500756f lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.978452:0:6569:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715205775.978453:0:6569:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000080:1.0:1715205775.978454:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147a140 x1798520455766016/t330712482623(0) o36->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 504/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00010000:00010000:2.0:1715205775.978454:0:6569:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715205775.978502:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+148:11754:x1798520455766016:12345-192.168.204.8@tcp:36:dbench.0 Request processed in 828us (970us total) trans 330712482623 rc 0/0 00000100:00100000:1.0:1715205775.978508:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1872 00010000:00010000:0.0:1715205775.979471:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af430500756f lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.979478:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af430500756f lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.979483:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af430500756f lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.979490:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd9bcc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.979491:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af430500756f lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.979496:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af430500756f lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.979504:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0xa992fa2d (ffff880129f26600) 00010000:00010000:0.0:1715205775.979506:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205775.979507:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af430500756f lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.979511:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af430500756f lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.979535:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007576 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.979540:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007576 lrc: 2/0,0 mode: EX/EX res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.979544:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007576 lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.979548:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd99680 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205775.979549:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007576 lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.979553:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007576 lrc: 4/0,0 mode: EX/EX res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.979559:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1012:0x0].0x0 (ffff880129f26500) 00010000:00010000:0.0:1715205775.979560:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715205775.979561:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007576 lrc: 2/0,0 mode: --/EX res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.979565:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007576 lrc: 0/0,0 mode: --/EX res: [0x20001b1b3:0x1012:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.979757:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.979802:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455766144 00000100:00100000:1.0:1715205775.979823:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 502 00000100:00100000:1.0:1715205775.979826:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c02850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+147:11754:x1798520455766144:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205775.979916:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880093c02850 x1798520455766144/t330712482624(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.979940:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c02850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+148:11754:x1798520455766144:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 114us (201us total) trans 330712482624 rc 0/0 00000100:00100000:1.0:1715205775.979949:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 502 00000100:00100000:3.0:1715205775.981788:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.981849:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455766272 00000100:00100000:1.0:1715205775.981888:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1873 00000100:00100000:1.0:1715205775.981892:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+148:11754:x1798520455766272:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.981906:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.981919:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af4305007584 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23791 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.981981:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af430500758b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.981992:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007530 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23775 expref: 149 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.981997:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af430500758b lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.982023:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007530 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23775 expref: 149 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.982032:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007530 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23775 expref: 149 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.982041:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456032000:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.982088:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b48b2840 going to sleep for 6 seconds 00000100:00100000:3.0:1715205775.983159:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.983179:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456032000:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205775.983196:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af430500758b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.983230:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455766336 00010000:00010000:0.0:1715205775.983247:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007530 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23775 expref: 150 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.983273:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4718 00000100:00100000:0.0:1715205775.983276:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131479300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+150:1830:x1798520455766336:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1715205775.983284:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.983287:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007530 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23775 expref: 150 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.983295:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007530 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23775 expref: 150 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.983306:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007530 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23775 expref: 150 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.983316:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1013:0x0].0x0 (ffff880135bf2600) 00010000:00010000:0.0:1715205775.983319:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af430500758b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.983328:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af430500758b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.983333:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af430500758b lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.983346:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205775.983361:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af430500758b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.983369:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af430500758b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.983372:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131479300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+149:1830:x1798520455766336:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 95us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.983378:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4718 00000004:00200000:1.0:1715205775.983380:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1013:0x0]: returning size 4096 00010000:00010000:1.0:1715205775.983461:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af4305007584 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23791 expref: 150 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.983471:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af430500758b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23791 expref: 149 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.983476:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1013:0x0].0x0 (ffff880135bf2600) 00010000:00010000:1.0:1715205775.983478:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205775.983480:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9a880, rc 0) 00010000:00000080:1.0:1715205775.983483:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147df00 x1798520455766272/t330712482625(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 648/656 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.983516:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+149:11754:x1798520455766272:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1623us (1738us total) trans 330712482625 rc 0/0 00000100:00100000:1.0:1715205775.983521:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1873 00000100:00100000:3.0:1715205775.984540:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.984599:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455766400 00000100:00100000:1.0:1715205775.984652:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1874 00000100:00100000:1.0:1715205775.984656:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+149:11754:x1798520455766400:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.984668:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.984675:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af4305007599 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23798 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.984702:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050075a0 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.984711:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af430500758b lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23791 expref: 150 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.984715:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050075a0 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.984731:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af430500758b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23791 expref: 150 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.984738:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af430500758b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23791 expref: 150 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205775.984759:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456032064:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205775.984788:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b48b2840 going to sleep for 6 seconds 00000100:00100000:1.0:1715205775.985577:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456032064:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205775.985590:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050075a0 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205775.986422:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.986475:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455766464 00010000:00010000:0.0:1715205775.986492:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af430500758b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23791 expref: 151 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205775.986523:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4719 00000100:00100000:0.0:1715205775.986527:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801314784c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:1830:x1798520455766464:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205775.986535:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205775.986585:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af430500758b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23791 expref: 151 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.986593:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af430500758b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23791 expref: 151 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.986604:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af430500758b lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23791 expref: 151 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205775.986613:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1013:0x0].0x0 (ffff880135bf2600) 00010000:00010000:0.0:1715205775.986616:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050075a0 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.986637:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050075a0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.986642:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050075a0 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205775.986654:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205775.987034:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050075a0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.987041:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050075a0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205775.987071:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1013:0x0]: returning size 4096 00000004:00200000:1.0:1715205775.987074:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205775.987085:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050075a0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.987093:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050075a0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.987114:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af4305007599 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23798 expref: 151 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.987124:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050075a0 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23798 expref: 150 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.987131:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1013:0x0].0x0 (ffff880135bf2600) 00010000:00010000:1.0:1715205775.987133:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205775.987134:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd99f80, rc 0) 00010000:00000080:1.0:1715205775.987138:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147a600 x1798520455766400/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 576/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.987187:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801314784c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+150:1830:x1798520455766464:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 659us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.987187:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+150:11754:x1798520455766400:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2530us (2647us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.987193:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4719 00000100:00100000:1.0:1715205775.987193:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1874 00000100:00100000:3.0:1715205775.988514:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.988544:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455766592 00000100:00100000:0.0:1715205775.988565:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 503 00000100:00100000:0.0:1715205775.988567:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+149:11754:x1798520455766592:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205775.988670:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147af80 x1798520455766592/t330712482626(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 392/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.988701:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+150:11754:x1798520455766592:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 133us (190us total) trans 330712482626 rc 0/0 00000100:00100000:0.0:1715205775.988707:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 503 00000100:00100000:3.0:1715205775.989607:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.989653:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455766656 00000100:00100000:1.0:1715205775.989683:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1875 00000100:00100000:1.0:1715205775.989687:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+150:11754:x1798520455766656:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.989698:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.989707:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af43050075a7 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2379f expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.989737:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af43050075ae lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.989762:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af43050075ae lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.989769:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af43050075ae lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.989779:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050075b5 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.989784:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050075b5 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.989788:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050075b5 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.989837:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af43050075ae lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.989843:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af43050075ae lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.989847:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af43050075ae lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.989852:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd9bcc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.989856:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af43050075ae lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.989861:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af43050075ae lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.989868:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.989870:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.989872:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af43050075ae lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.989876:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af43050075ae lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.989883:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050075b5 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.989887:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050075b5 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.989891:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050075b5 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.989895:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd9aac0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.989896:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050075b5 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.989900:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050075b5 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.989905:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0xc88ea4fb (ffff880129f26500) 00010000:00010000:1.0:1715205775.989907:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.989908:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050075b5 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.989912:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050075b5 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.989951:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af43050075a7 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2379f expref: 151 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.989956:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af43050075a7 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2379f expref: 151 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.989962:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd99680, rc 0) 00010000:00000080:1.0:1715205775.989965:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147d0c0 x1798520455766656/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.989993:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+150:11754:x1798520455766656:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 305us (387us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205775.989999:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1875 00000100:00100000:3.0:1715205775.991076:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.991119:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455766720 00000100:00100000:1.0:1715205775.991147:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1876 00000100:00100000:1.0:1715205775.991151:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+150:11754:x1798520455766720:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.991158:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.991164:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af43050075bc lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b237a6 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.991179:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af43050075bc lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237a6 expref: 151 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.991191:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af43050075bc lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237a6 expref: 151 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.991197:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.991198:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.991200:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9a880, rc 0) 00010000:00000080:1.0:1715205775.991202:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147bdc0 x1798520455766720/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 328/344 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.991234:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:11754:x1798520455766720:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 82us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205775.991239:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1876 00000100:00100000:3.0:1715205775.992703:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205775.992768:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455766784 00000100:00100000:0.0:1715205775.992803:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 504 00000100:00100000:0.0:1715205775.992808:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:11754:x1798520455766784:12345-192.168.204.8@tcp:37:dbench.0 00010000:00000080:0.0:1715205775.994693:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147c740 x1798520455766784/t0(0) o37->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 448/440 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205775.994733:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:11754:x1798520455766784:12345-192.168.204.8@tcp:37:dbench.0 Request processed in 1924us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205775.994753:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 504 00000100:00100000:3.0:1715205775.996259:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.996578:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455766848 00000100:00100000:1.0:1715205775.996642:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1877 00000100:00100000:1.0:1715205775.996647:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b2ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:11754:x1798520455766848:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205775.996661:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205775.996674:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af43050075c3 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b237ad expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.996715:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050075ca lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.996725:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050075ca lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.996734:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050075ca lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.996761:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050075d1 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.996767:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050075d1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.996772:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050075d1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.996826:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050075ca lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.996832:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050075ca lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.996837:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050075ca lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.996842:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd9b840 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.996844:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050075ca lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.996849:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050075ca lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.996857:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.996859:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.996861:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050075ca lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.996868:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050075ca lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.996893:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050075d1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.996898:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050075d1 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.996902:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050075d1 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.996906:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd9ad00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.996907:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050075d1 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.996912:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050075d1 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.996917:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0xc88ea4fb (ffff880129f26e00) 00010000:00010000:1.0:1715205775.996918:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.996919:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050075d1 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.996923:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050075d1 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.996953:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af43050075c3 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237ad expref: 152 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.996962:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af43050075c3 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237ad expref: 152 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.996967:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9af40, rc 0) 00010000:00000080:1.0:1715205775.996970:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b2ac0 x1798520455766848/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/640 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.997009:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b2ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:11754:x1798520455766848:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 362us (752us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205775.997014:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1877 00000100:00100000:3.0:1715205775.998276:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205775.998327:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455766976 00000100:00100000:1.0:1715205775.998359:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1878 00000100:00100000:1.0:1715205775.998363:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b3440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:11754:x1798520455766976:12345-192.168.204.8@tcp:36:dbench.0 00010000:00010000:1.0:1715205775.998389:0:14185:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1715205775.998401:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050075a0 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23798 expref: 151 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.998415:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050074c7 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23744 expref: 150 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.998422:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1013:0x0].0x0 (ffff880135bf2600) 00010000:00010000:1.0:1715205775.998431:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af43050075bc lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237a6 expref: 149 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.998437:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.998439:0:14185:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205775.998471:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af43050075d8 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.998479:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af43050075d8 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.998485:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af43050075d8 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.998493:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af43050075df lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.998497:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af43050075df lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.998500:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af43050075df lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.998510:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af43050075e6 lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.998513:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af43050075e6 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.998515:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af43050075e6 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.998585:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af43050075ed lrc: 3/0,1 mode: --/EX res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.998591:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af43050075ed lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.998597:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af43050075ed lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715205775.998847:0:14185:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff8800a61b3440 reply state ffff8800939ef000 transno 330712482627 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af43050075ed lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715205775.998854:0:14185:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff8800a61b3440 reply state ffff8800939ef000 transno 330712482627 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af43050075e6 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.998859:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af43050075d8 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.998863:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af43050075d8 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.998867:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af43050075d8 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.998872:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd986c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205775.998873:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af43050075d8 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.998877:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af43050075d8 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.998883:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205775.998885:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205775.998886:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af43050075d8 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205775.998891:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af43050075d8 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1715205775.998896:0:14185:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff8800a61b3440 reply state ffff8800939ef000 transno 330712482627 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af43050075df lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00000080:1.0:1715205775.998907:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b3440 x1798520455766976/t330712482627(0) o36->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 528/456 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205775.998948:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b3440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+150:11754:x1798520455766976:12345-192.168.204.8@tcp:36:dbench.0 Request processed in 584us (673us total) trans 330712482627 rc 0/0 00000100:00100000:1.0:1715205775.998953:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1878 00010000:00010000:2.0:1715205775.999641:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af43050075df lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.999649:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af43050075df lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.999654:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af43050075df lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.999658:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd98240 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.999661:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af43050075df lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.999665:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af43050075df lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.999672:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0xa992fa36 (ffff880129f26200) 00010000:00010000:2.0:1715205775.999674:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.999675:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af43050075df lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.999679:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af43050075df lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.999706:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af43050075e6 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.999711:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af43050075e6 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.999714:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af43050075e6 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.999717:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd9a1c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.999719:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af43050075e6 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.999722:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af43050075e6 lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.999727:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0xc88ea4fb (ffff880129f26600) 00010000:00010000:2.0:1715205775.999729:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205775.999731:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af43050075e6 lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.999734:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af43050075e6 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.999754:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af43050075ed lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.999758:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af43050075ed lrc: 2/0,0 mode: EX/EX res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.999761:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af43050075ed lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.999765:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd99680 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205775.999766:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af43050075ed lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.999769:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af43050075ed lrc: 4/0,0 mode: EX/EX res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205775.999774:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:2.0:1715205775.999774:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1013:0x0].0x0 (ffff880129f26300) 00010000:00010000:2.0:1715205775.999775:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1715205775.999776:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af43050075ed lrc: 2/0,0 mode: --/EX res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.999779:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af43050075ed lrc: 0/0,0 mode: --/EX res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205775.999844:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455767040 00000100:00100000:2.0:1715205775.999884:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1879 00000100:00100000:2.0:1715205775.999888:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66dd0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+149:11754:x1798520455767040:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205775.999898:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205775.999905:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050075f4 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b237b4 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.999929:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af43050075fb lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.999935:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af43050075fb lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.999939:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af43050075fb lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.999947:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007602 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.999956:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007602 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205775.999960:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007602 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.000003:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007609 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.000007:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007609 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.000012:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007609 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.000029:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1013:0x0]: returning size 4096 00000004:00200000:2.0:1715205776.000031:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.000040:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007609 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.000047:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007609 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.000052:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af43050075fb lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.000056:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af43050075fb lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.000060:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af43050075fb lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.000064:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedf600 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.000065:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af43050075fb lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.000069:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af43050075fb lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.000074:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.000075:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.000077:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af43050075fb lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.000081:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af43050075fb lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.000087:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007602 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.000091:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007602 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.000095:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007602 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.000098:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedc000 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.000098:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007602 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.000102:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007602 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.000105:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0xc88ea4fb (ffff880092bfc600) 00010000:00010000:2.0:1715205776.000106:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.000107:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007602 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.000110:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007602 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.000124:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050075f4 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237b4 expref: 151 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.000133:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007609 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237b4 expref: 150 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.000137:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1013:0x0].0x0 (ffff880092bfcb00) 00010000:00010000:2.0:1715205776.000139:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.000140:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedcb40, rc 0) 00010000:00000080:2.0:1715205776.000143:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a66dd0c0 x1798520455767040/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:556/0 lens 584/696 e 0 to 0 dl 1715205781 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.000175:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66dd0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+150:11754:x1798520455767040:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 286us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.000180:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1879 00000100:00100000:3.0:1715205776.001249:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.001300:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455767168 00000100:00100000:2.0:1715205776.001332:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1880 00000100:00100000:2.0:1715205776.001336:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+150:11754:x1798520455767168:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.001344:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.001351:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af4305007610 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b237bb expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.001393:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007617 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.001402:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007609 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237b4 expref: 151 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.001407:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007617 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.001435:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007609 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237b4 expref: 151 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.001444:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007609 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237b4 expref: 151 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205776.001454:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2217c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456032128:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.001499:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31c00 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.002392:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c2217c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456032128:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.002401:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:2.0:1715205776.002408:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007617 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.002456:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455767232 00010000:00010000:0.0:1715205776.002487:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007609 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237b4 expref: 152 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205776.002522:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4720 00000100:00100000:0.0:1715205776.002527:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+152:1830:x1798520455767232:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1715205776.002539:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.002544:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007609 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237b4 expref: 152 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205776.002552:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007609 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237b4 expref: 152 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205776.002569:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007609 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237b4 expref: 152 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205776.002583:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1013:0x0].0x0 (ffff880092bfcb00) 00010000:00010000:0.0:1715205776.002586:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007617 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.002594:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007617 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.002599:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007617 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.002653:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007617 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.002654:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.002659:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007617 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.002670:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1013:0x0]: returning size 4096 00000100:00100000:0.0:1715205776.002694:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:1830:x1798520455767232:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 167us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.002700:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4720 00010000:00010000:2.0:1715205776.002772:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af4305007610 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237bb expref: 152 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.002784:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007617 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237bb expref: 151 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.002789:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1013:0x0].0x0 (ffff880092bfcb00) 00010000:00010000:2.0:1715205776.002791:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.002793:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eeddd40, rc 0) 00010000:00000080:2.0:1715205776.002796:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b3900 x1798520455767168/t330712482628(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.002833:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:11754:x1798520455767168:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1496us (1585us total) trans 330712482628 rc 0/0 00000100:00100000:2.0:1715205776.002839:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1880 00000100:00100000:3.0:1715205776.003672:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.003766:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455767296 00000100:00100000:2.0:1715205776.003804:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1881 00000100:00100000:2.0:1715205776.003809:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:11754:x1798520455767296:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.003821:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.003829:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af4305007625 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b237c2 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.003860:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc240/0xb608af430500762c lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.003868:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007617 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237bb expref: 152 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.003874:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc240/0xb608af430500762c lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.003891:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007617 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237bb expref: 152 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.003899:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007617 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237bb expref: 152 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205776.003906:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2217c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456032192:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.003945:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31c00 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.005380:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c2217c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456032192:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.005400:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc240/0xb608af430500762c lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.006413:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.006454:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455767360 00010000:00010000:0.0:1715205776.006476:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007617 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237bb expref: 153 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205776.006503:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4721 00000100:00100000:0.0:1715205776.006507:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b7200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:1831:x1798520455767360:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1715205776.006516:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.006521:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007617 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237bb expref: 153 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205776.006530:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007617 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237bb expref: 153 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205776.006545:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddd40/0xb608af4305007617 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237bb expref: 153 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205776.006553:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1013:0x0].0x0 (ffff880092bfcb00) 00010000:00010000:0.0:1715205776.006555:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc240/0xb608af430500762c lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.006560:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc240/0xb608af430500762c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.006566:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc240/0xb608af430500762c lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.006587:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.006614:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b7200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+152:1831:x1798520455767360:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 107us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.006631:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4721 00010000:00010000:2.0:1715205776.006640:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc240/0xb608af430500762c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.006647:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc240/0xb608af430500762c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.006674:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1013:0x0]: returning size 4096 00000004:00200000:2.0:1715205776.006678:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.006688:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc240/0xb608af430500762c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.006695:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc240/0xb608af430500762c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.006711:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af4305007625 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237c2 expref: 152 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.006720:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc240/0xb608af430500762c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237c2 expref: 151 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.006725:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1013:0x0].0x0 (ffff880092bfcb00) 00010000:00010000:2.0:1715205776.006727:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.006728:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedc240, rc 0) 00010000:00000080:2.0:1715205776.006732:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b6d40 x1798520455767296/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.006783:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:11754:x1798520455767296:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2974us (3113us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.006789:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1881 00000100:00100000:3.0:1715205776.007765:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.007858:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455767424 00000100:00100000:2.0:1715205776.007893:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1882 00000100:00100000:2.0:1715205776.007897:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:11754:x1798520455767424:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.007914:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.007927:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af4305007633 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b237c9 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.007955:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af430500763a lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.007963:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af430500763a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.007969:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af430500763a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.007979:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af4305007641 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x778ea4fb bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.007983:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af4305007641 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.007987:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af4305007641 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.008039:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af430500763a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.008044:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af430500763a lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.008049:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af430500763a lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.008053:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedeac0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.008056:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af430500763a lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.008061:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af430500763a lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.008067:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.008069:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.008071:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af430500763a lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.008074:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af430500763a lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.008081:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af4305007641 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.008084:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af4305007641 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.008092:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af4305007641 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.008096:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eede640 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.008097:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af4305007641 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.008101:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af4305007641 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.008106:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x778ea4fb (ffff880092bfc400) 00010000:00010000:2.0:1715205776.008108:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.008109:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af4305007641 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.008113:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af4305007641 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.008138:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af4305007633 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237c9 expref: 152 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.008144:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af4305007633 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237c9 expref: 152 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.008151:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedc900, rc 0) 00010000:00000080:2.0:1715205776.008154:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b76c0 x1798520455767424/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.008183:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:11754:x1798520455767424:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 285us (419us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205776.008188:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1882 00000100:00100000:0.0:1715205776.009263:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.009305:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455767488 00000100:00100000:2.0:1715205776.009328:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1883 00000100:00100000:2.0:1715205776.009332:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66dbdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:11754:x1798520455767488:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.009339:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.009345:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af4305007648 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b237d0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.009364:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af4305007648 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237d0 expref: 152 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.009372:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af4305007648 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237d0 expref: 152 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.009377:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.009378:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.009380:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedfcc0, rc 0) 00010000:00000080:2.0:1715205776.009382:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a66dbdc0 x1798520455767488/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 328/344 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.009418:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66dbdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+152:11754:x1798520455767488:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 85us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.009423:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1883 00000100:00100000:3.0:1715205776.010708:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.010805:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455767552 00000100:00100000:0.0:1715205776.010854:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 505 00000100:00100000:0.0:1715205776.010859:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+152:11754:x1798520455767552:12345-192.168.204.8@tcp:37:dbench.0 00010000:00000080:0.0:1715205776.013260:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b4280 x1798520455767552/t0(0) o37->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 448/440 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.013304:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+152:11754:x1798520455767552:12345-192.168.204.8@tcp:37:dbench.0 Request processed in 2445us (2597us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.013310:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 505 00000100:00100000:2.0:1715205776.015106:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.015159:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455767680 00000100:00100000:0.0:1715205776.015206:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1884 00000100:00100000:0.0:1715205776.015212:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2217c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+152:11754:x1798520455767680:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.015229:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.015232:0:14860:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1715205776.015258:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af4305007648 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237d0 expref: 152 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.015275:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.015280:0:14860:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.015291:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af430500764f lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b237d7 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.015415:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007656 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.015427:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007656 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.015435:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007656 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.015446:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af430500765d lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x778ea4fb bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.015451:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af430500765d lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.015455:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af430500765d lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715205776.015822:0:14860:0:(osp_object.c:1645:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x100010000:0x15db:0x0], index 1: 0 00010000:00010000:0.0:1715205776.015953:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305007664 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.015960:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305007664 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.015966:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305007664 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.015997:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007656 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.016003:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007656 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.016008:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007656 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.016013:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099172ac0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.016016:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007656 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.016022:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007656 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.016029:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.016031:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.016033:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007656 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.016037:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af4305007656 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715205776.016045:0:14860:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88012c2217c0 reply state ffff88012cca2000 transno 330712482629 ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af430500765d lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.016063:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af430500764f lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237d7 expref: 154 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.016076:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305007664 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237d7 expref: 153 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.016082:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:0.0:1715205776.016084:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1715205776.016085:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099170d80, rc 0) 00010000:00000080:0.0:1715205776.016089:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c2217c0 x1798520455767680/t330712482629(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 656/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.016156:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2217c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+154:11754:x1798520455767680:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 944us (1052us total) trans 330712482629 rc 0/0 00000100:00100000:0.0:1715205776.016163:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1884 00010000:00010000:0.0:1715205776.016919:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af430500765d lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.016931:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af430500765d lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.016936:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af430500765d lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.016941:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800991721c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.016944:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af430500765d lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.016949:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af430500765d lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.016963:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x778ea4fb (ffff880135bf2300) 00010000:00010000:0.0:1715205776.016965:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.016967:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af430500765d lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.016970:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af430500765d lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.017491:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.017558:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455767744 00000100:00100000:0.0:1715205776.017598:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1885 00000100:00100000:0.0:1715205776.017603:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c222140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:11754:x1798520455767744:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.017645:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.017655:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305007672 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b237de expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.017695:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007679 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.017704:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007679 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.017711:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007679 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.017737:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205776.017762:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007679 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.017773:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007679 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.017789:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305007672 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237de expref: 155 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.017799:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007679 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237de expref: 154 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.017805:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:0.0:1715205776.017806:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205776.017808:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099172d00, rc 0) 00010000:00000080:0.0:1715205776.017812:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c222140 x1798520455767744/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.017857:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c222140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+154:11754:x1798520455767744:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 254us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.017862:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1885 00000100:00100000:3.0:1715205776.018775:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.018819:0:20898:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455767808 00000100:00100000:2.0:1715205776.018850:0:20898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14693 00000100:00100000:2.0:1715205776.018854:0:20898:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+43:1830:x1798520455767808:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.018862:0:20898:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.018873:0:20898:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eedcb40/0xb608af4305007680 lrc: 2/0,0 mode: --/PR res: [0x15db:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b237e5 expref: -99 pid: 20898 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1715205776.018890:0:20898:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x15db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1715205776.018901:0:20898:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715205776.018902:0:20898:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715205776.018908:0:20898:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eedcb40/0xb608af4305007680 lrc: 3/0,0 mode: PR/PR res: [0x15db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237e5 expref: 44 pid: 20898 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715205776.018917:0:20898:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eedcb40/0xb608af4305007680 lrc: 3/0,0 mode: PR/PR res: [0x15db:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237e5 expref: 44 pid: 20898 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715205776.018924:0:20898:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedcb40, rc 0) 00000100:00100000:2.0:1715205776.018955:0:20898:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+44:1830:x1798520455767808:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 100us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.018960:0:20898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14693 00000100:00100000:3.0:1715205776.019718:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.019774:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455767936 00000100:00100000:0.0:1715205776.019807:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 506 00000100:00100000:0.0:1715205776.019811:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+154:11754:x1798520455767936:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205776.019996:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b0000 x1798520455767936/t330712482630(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.020028:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+155:11754:x1798520455767936:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 216us (312us total) trans 330712482630 rc 0/0 00000100:00100000:0.0:1715205776.020033:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 506 00000100:00100000:0.0:1715205776.021144:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.021203:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455768064 00000100:00100000:2.0:1715205776.021233:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1886 00000100:00100000:2.0:1715205776.021237:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66dcc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+155:11754:x1798520455768064:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.021246:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.021256:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305007687 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b237ec expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.021305:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500768e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.021320:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007679 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237de expref: 156 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.021326:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500768e lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.021349:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007679 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237de expref: 156 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.021359:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007679 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237de expref: 156 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205776.021368:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c223440 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456032256:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.021417:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31c00 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.022285:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c223440 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456032256:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.022304:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500768e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.022348:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.022390:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455768128 00010000:00010000:2.0:1715205776.022403:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007679 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237de expref: 157 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205776.022429:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4722 00000100:00100000:2.0:1715205776.022433:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66d8980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+157:1830:x1798520455768128:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1715205776.022440:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.022443:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007679 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237de expref: 157 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205776.022451:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007679 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237de expref: 157 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205776.022463:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007679 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237de expref: 157 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205776.022482:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:2.0:1715205776.022485:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500768e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.022490:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500768e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.022496:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500768e lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.022516:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.022541:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500768e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.022548:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66d8980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:1830:x1798520455768128:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 115us (203us total) trans 0 rc 0/0 00010000:00010000:0.0:1715205776.022550:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500768e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.022554:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4722 00000004:00200000:0.0:1715205776.022561:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1014:0x0]: returning size 0 00010000:00010000:0.0:1715205776.022652:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305007687 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237ec expref: 157 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.022662:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500768e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237ec expref: 156 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.022668:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:0.0:1715205776.022670:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205776.022672:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eeddb00, rc 0) 00010000:00000080:0.0:1715205776.022675:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a66dcc00 x1798520455768064/t330712482631(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.022700:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66dcc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455768064:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1462us (1557us total) trans 330712482631 rc 0/0 00000100:00100000:0.0:1715205776.022706:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1886 00000100:00100000:0.0:1715205776.023703:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.023756:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455768192 00000100:00100000:2.0:1715205776.023783:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1887 00000100:00100000:2.0:1715205776.023787:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455768192:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.023796:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.023804:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af430500769c lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b237f3 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.023831:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af43050076a3 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.023836:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500768e lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237ec expref: 157 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.023840:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af43050076a3 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.023851:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500768e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237ec expref: 157 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.023856:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500768e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237ec expref: 157 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205776.023861:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c223440 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456032320:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.023891:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31c00 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.024613:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c223440 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456032320:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.024640:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af43050076a3 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.024664:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.024687:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455768256 00010000:00010000:0.0:1715205776.024699:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500768e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237ec expref: 158 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205776.024729:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4723 00000100:00100000:0.0:1715205776.024732:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b521e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+158:1831:x1798520455768256:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205776.024793:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.024797:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500768e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237ec expref: 158 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205776.024804:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500768e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237ec expref: 158 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205776.024814:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af430500768e lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237ec expref: 158 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205776.024821:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:0.0:1715205776.024823:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af43050076a3 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.024828:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af43050076a3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.024832:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af43050076a3 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.024849:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.024870:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b521e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+157:1831:x1798520455768256:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 137us (207us total) trans 0 rc 0/0 00010000:00010000:2.0:1715205776.024871:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af43050076a3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.024876:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4723 00010000:00010000:2.0:1715205776.024877:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af43050076a3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.024902:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1014:0x0]: returning size 0 00000004:00200000:2.0:1715205776.024905:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.024917:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af43050076a3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.024923:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af43050076a3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.024937:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af430500769c lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237f3 expref: 157 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.024945:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af43050076a3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237f3 expref: 156 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.024950:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:2.0:1715205776.024951:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.024952:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedc900, rc 0) 00010000:00000080:2.0:1715205776.024955:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6a4aac0 x1798520455768192/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.024980:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455768192:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1193us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.024985:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1887 00000100:00100000:0.0:1715205776.025844:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.025940:0:20898:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455768320 00000100:00100000:2.0:1715205776.025982:0:20898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14694 00000100:00100000:2.0:1715205776.025991:0:20898:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+44:11754:x1798520455768320:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.026004:0:20898:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.026019:0:20898:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009eeddd40/0xb608af43050076aa lrc: 2/0,0 mode: --/PW res: [0x15db:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b237fa expref: -99 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.026045:0:20898:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eedcb40/0xb608af4305007680 lrc: 2/0,0 mode: PR/PR res: [0x15db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237e5 expref: 45 pid: 20898 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715205776.026051:0:20898:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715205776.026053:0:20898:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715205776.026055:0:20898:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eeddd40/0xb608af43050076aa lrc: 4/0,0 mode: --/PW res: [0x15db:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237fa expref: 45 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.026080:0:20898:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009eedcb40/0xb608af4305007680 lrc: 3/0,0 mode: PR/PR res: [0x15db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237e5 expref: 45 pid: 20898 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715205776.026089:0:20898:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009eedcb40/0xb608af4305007680 lrc: 4/0,0 mode: PR/PR res: [0x15db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237e5 expref: 45 pid: 20898 timeout: 3135 lvb_type: 1 00000100:00100000:2.0:1715205776.026099:0:20898:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c223440 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20898:1798520456032384:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.026147:0:20898:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31c00 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.026982:0:20898:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c223440 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20898:1798520456032384:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.026994:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:2.0:1715205776.026999:0:20898:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009eeddd40/0xb608af43050076aa lrc: 3/0,0 mode: --/PW res: [0x15db:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237fa expref: 45 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.027009:0:20898:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eeddd40, rc 0) 00000100:00100000:2.0:1715205776.027047:0:20898:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+45:11754:x1798520455768320:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1055us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.027053:0:20898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14694 00000100:00100000:0.0:1715205776.027124:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455768384 00010000:00010000:0.0:1715205776.027139:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009eedcb40/0xb608af4305007680 lrc: 4/0,0 mode: PR/PR res: [0x15db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237e5 expref: 45 pid: 20898 timeout: 3135 lvb_type: 1 00000100:00100000:0.0:1715205776.027181:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4724 00000100:00100000:0.0:1715205776.027185:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b1c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+45:1831:x1798520455768384:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1715205776.027199:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.027218:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009eedcb40/0xb608af4305007680 lrc: 4/0,0 mode: PR/PR res: [0x15db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237e5 expref: 45 pid: 20898 timeout: 3135 lvb_type: 1 00010000:00010000:0.0:1715205776.027227:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009eedcb40/0xb608af4305007680 lrc: 3/0,0 mode: PR/PR res: [0x15db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237e5 expref: 45 pid: 20898 timeout: 3135 lvb_type: 1 00010000:00010000:0.0:1715205776.027243:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eedcb40/0xb608af4305007680 lrc: 0/0,0 mode: --/PR res: [0x15db:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237e5 expref: 45 pid: 20898 timeout: 3135 lvb_type: 1 00010000:00010000:0.0:1715205776.027253:0:8315:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205776.027255:0:8315:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205776.027259:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eeddd40/0xb608af43050076aa lrc: 2/0,0 mode: PW/PW res: [0x15db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237fa expref: 44 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.027267:0:8315:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009eeddd40/0xb608af43050076aa lrc: 3/0,0 mode: PW/PW res: [0x15db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237fa expref: 44 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.027285:0:8315:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009eeddd40/0xb608af43050076aa lrc: 3/0,0 mode: PW/PW res: [0x15db:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237fa expref: 44 pid: 20898 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.027293:0:8315:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6a4af80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8315:1798520456032448:192.168.204.8@tcp:105: 00000100:00100000:0.0:1715205776.027332:0:8315:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b40c0 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.028224:0:8315:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6a4af80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8315:1798520456032448:192.168.204.8@tcp:105: 00010000:00010000:0.0:1715205776.028241:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.028278:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b1c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+44:1831:x1798520455768384:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 1092us (1284us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.028285:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4724 00000100:00100000:3.0:1715205776.028686:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.028723:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455768512 00000100:00100000:0.0:1715205776.028763:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 507 00000100:00100000:0.0:1715205776.028767:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c06850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455768512:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205776.028943:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880093c06850 x1798520455768512/t330712482632(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.028981:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c06850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+157:11754:x1798520455768512:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 213us (296us total) trans 330712482632 rc 0/0 00000100:00100000:0.0:1715205776.028986:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 507 00000100:00100000:3.0:1715205776.030390:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.030443:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455768640 00000100:00100000:2.0:1715205776.030475:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1888 00000100:00100000:2.0:1715205776.030479:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b0980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+157:11754:x1798520455768640:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.030492:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.030505:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af43050076b1 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23801 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.030559:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050076b8 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.030571:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af43050076a3 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237f3 expref: 158 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.030577:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050076b8 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.030600:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af43050076a3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237f3 expref: 158 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.030609:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af43050076a3 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237f3 expref: 158 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205776.030642:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c223440 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456032512:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.030685:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31c00 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.031378:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c223440 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456032512:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.031395:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050076b8 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.031503:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.031526:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455768704 00010000:00010000:0.0:1715205776.031546:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af43050076a3 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237f3 expref: 159 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205776.031569:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4725 00000100:00100000:0.0:1715205776.031573:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b0e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+159:1831:x1798520455768704:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1715205776.031581:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.031586:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af43050076a3 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237f3 expref: 159 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205776.031594:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af43050076a3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237f3 expref: 159 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205776.031609:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af43050076a3 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237f3 expref: 159 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205776.031637:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:0.0:1715205776.031641:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050076b8 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.031648:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050076b8 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.031653:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050076b8 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.031675:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.031701:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050076b8 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.031706:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b0e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+158:1831:x1798520455768704:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 132us (204us total) trans 0 rc 0/0 00010000:00010000:2.0:1715205776.031708:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050076b8 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.031713:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4725 00000004:00200000:2.0:1715205776.031728:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1014:0x0]: returning size 2048 00010000:00010000:2.0:1715205776.031842:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af43050076b1 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23801 expref: 159 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.031852:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050076b8 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23801 expref: 158 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.031857:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:2.0:1715205776.031859:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.031861:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedeac0, rc 0) 00010000:00000080:2.0:1715205776.031865:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b0980 x1798520455768640/t330712482633(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.031896:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b0980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+158:11754:x1798520455768640:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1416us (1510us total) trans 330712482633 rc 0/0 00000100:00100000:2.0:1715205776.031903:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1888 00000100:00100000:3.0:1715205776.032732:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.032790:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455768768 00000100:00100000:2.0:1715205776.032822:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1889 00000100:00100000:2.0:1715205776.032826:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+158:11754:x1798520455768768:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.032839:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.032847:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af43050076c6 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23808 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.032881:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050076cd lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.032890:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050076b8 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23801 expref: 159 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.032897:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050076cd lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.032915:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050076b8 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23801 expref: 159 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.032924:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050076b8 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23801 expref: 159 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205776.032934:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c222600 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456032576:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.032985:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31480 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.033658:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c222600 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456032576:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.033668:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050076cd lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.033777:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.033812:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455768832 00010000:00010000:0.0:1715205776.033833:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050076b8 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23801 expref: 160 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205776.033858:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4726 00000100:00100000:0.0:1715205776.033863:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b5580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+160:1831:x1798520455768832:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1715205776.033875:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.033880:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050076b8 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23801 expref: 160 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205776.033888:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050076b8 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23801 expref: 160 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205776.033903:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050076b8 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23801 expref: 160 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:0.0:1715205776.033914:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:0.0:1715205776.033917:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050076cd lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.033923:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050076cd lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.033928:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050076cd lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.033952:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.033974:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050076cd lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.033980:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050076cd lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.033986:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b5580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+159:1831:x1798520455768832:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 123us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.033992:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4726 00000004:00200000:2.0:1715205776.034005:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1014:0x0]: returning size 2048 00000004:00200000:2.0:1715205776.034008:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.034021:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050076cd lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.034030:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050076cd lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.034045:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af43050076c6 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23808 expref: 159 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.034055:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050076cd lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23808 expref: 158 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.034061:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:2.0:1715205776.034063:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.034064:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedf3c0, rc 0) 00010000:00000080:2.0:1715205776.034068:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b63c0 x1798520455768768/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.034101:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+158:11754:x1798520455768768:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1275us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.034108:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1889 00000100:00100000:3.0:1715205776.035264:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.035324:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455768896 00000100:00100000:2.0:1715205776.035357:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1890 00000100:00100000:2.0:1715205776.035361:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+158:11754:x1798520455768896:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.035372:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.035380:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af43050076d4 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2380f expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.035409:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af43050076db lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.035418:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af43050076db lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.035430:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af43050076db lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.035441:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050076e2 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.035446:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050076e2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.035452:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050076e2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.035516:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af43050076db lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.035522:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af43050076db lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.035527:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af43050076db lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.035532:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedfcc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.035535:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af43050076db lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.035541:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af43050076db lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.035548:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.035551:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.035552:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af43050076db lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.035557:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af43050076db lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.035565:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050076e2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.035569:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050076e2 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.035573:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050076e2 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.035578:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedc6c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.035579:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050076e2 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.035584:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050076e2 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.035589:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x78ea50f (ffff880092bfc200) 00010000:00010000:2.0:1715205776.035591:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.035592:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050076e2 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.035596:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050076e2 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.035651:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af43050076d4 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2380f expref: 159 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.035658:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af43050076d4 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2380f expref: 159 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.035665:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eede1c0, rc 0) 00010000:00000080:2.0:1715205776.035668:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b1300 x1798520455768896/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.035701:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+158:11754:x1798520455768896:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 340us (440us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205776.035707:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1890 00000100:00100000:0.0:1715205776.036643:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.036716:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455768960 00000100:00100000:2.0:1715205776.036754:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1891 00000100:00100000:2.0:1715205776.036758:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+158:11754:x1798520455768960:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.036766:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.036773:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af43050076e9 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23816 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.036791:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af43050076e9 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23816 expref: 159 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.036798:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af43050076e9 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23816 expref: 159 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.036804:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.036806:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.036808:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedc000, rc 0) 00010000:00000080:2.0:1715205776.036811:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6a4af80 x1798520455768960/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 328/344 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.036846:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+159:11754:x1798520455768960:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 88us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.036851:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1891 00000100:00100000:3.0:1715205776.037970:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.038047:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455769024 00000100:00100000:0.0:1715205776.038086:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 508 00000100:00100000:0.0:1715205776.038090:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+159:11754:x1798520455769024:12345-192.168.204.8@tcp:37:dbench.0 00010000:00000080:0.0:1715205776.039829:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b2140 x1798520455769024/t0(0) o37->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 448/440 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.039866:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+159:11754:x1798520455769024:12345-192.168.204.8@tcp:37:dbench.0 Request processed in 1776us (1898us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.039871:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 508 00000100:00100000:2.0:1715205776.041192:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.041247:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455769088 00000100:00100000:0.0:1715205776.041297:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1892 00000100:00100000:0.0:1715205776.041302:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c222600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+159:11754:x1798520455769088:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.041318:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.041336:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af43050076f0 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2381d expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.041386:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050076f7 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.041398:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050076f7 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.041408:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050076f7 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.041419:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af43050076fe lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.041424:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af43050076fe lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.041429:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af43050076fe lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.041490:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050076f7 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.041496:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050076f7 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.041500:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050076f7 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.041505:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099173600 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.041508:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050076f7 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.041513:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050076f7 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.041522:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.041524:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.041527:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050076f7 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.041531:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af43050076f7 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.041541:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af43050076fe lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.041545:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af43050076fe lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.041554:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af43050076fe lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.041558:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099170900 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.041560:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af43050076fe lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.041564:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af43050076fe lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.041570:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0xec6f74b7 (ffff880135bf2300) 00010000:00010000:0.0:1715205776.041571:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.041572:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af43050076fe lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.041577:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af43050076fe lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.041610:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af43050076f0 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2381d expref: 160 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.041645:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af43050076f0 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2381d expref: 160 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.041655:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099172d00, rc 0) 00010000:00000080:0.0:1715205776.041659:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c222600 x1798520455769088/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.041700:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c222600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+159:11754:x1798520455769088:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 398us (510us total) trans 0 rc 301/301 00000100:00100000:0.0:1715205776.041707:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1892 00000100:00100000:3.0:1715205776.043287:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.043377:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455769152 00000100:00100000:0.0:1715205776.043420:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1893 00000100:00100000:0.0:1715205776.043425:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b3dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+159:11754:x1798520455769152:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.043439:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.043454:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305007705 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23824 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.043495:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500770c lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.043505:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500770c lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.043512:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500770c lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.043520:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305007713 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x9c159348 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.043523:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305007713 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.043526:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305007713 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.043575:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500770c lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.043584:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500770c lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.043589:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500770c lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.043593:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099170480 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.043596:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500770c lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.043601:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500770c lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.043608:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.043610:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.043612:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500770c lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.043615:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500770c lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.043643:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305007713 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.043647:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305007713 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.043651:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305007713 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.043659:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099170fc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.043661:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305007713 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.043665:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305007713 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.043671:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x9c159348 (ffff880135bf2200) 00010000:00010000:0.0:1715205776.043673:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.043674:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305007713 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.043678:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305007713 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.043708:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305007705 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23824 expref: 160 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.043714:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305007705 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23824 expref: 160 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.043721:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099172640, rc 0) 00010000:00000080:0.0:1715205776.043725:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b3dc0 x1798520455769152/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.043779:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b3dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+159:11754:x1798520455769152:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 353us (496us total) trans 0 rc 301/301 00000100:00100000:0.0:1715205776.043785:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1893 00000100:00100000:3.0:1715205776.047132:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.047246:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455769280 00000100:00100000:0.0:1715205776.047311:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1894 00000100:00100000:0.0:1715205776.047317:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+159:11754:x1798520455769280:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.047337:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.047356:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170000/0xb608af430500771a lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2382b expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.047451:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305007721 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.047466:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af4305006e29 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234dc expref: 160 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.047473:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305007721 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.047508:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af4305006e29 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234dc expref: 160 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.047518:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af4305006e29 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234dc expref: 160 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205776.047530:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456032640:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.047601:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b43c0 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.048581:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.048671:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456032640:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.048691:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305007721 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.048715:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455769344 00010000:00010000:1.0:1715205776.048748:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af4305006e29 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234dc expref: 161 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205776.048782:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4727 00000100:00100000:1.0:1715205776.048787:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c223dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+161:1831:x1798520455769344:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1715205776.048799:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.048803:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af4305006e29 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234dc expref: 161 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205776.048811:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af4305006e29 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234dc expref: 161 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205776.048826:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940cb3c0/0xb608af4305006e29 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234dc expref: 161 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205776.048848:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:1.0:1715205776.048851:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305007721 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.048858:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305007721 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.048864:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305007721 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.048879:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.048887:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305007721 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.048894:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305007721 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.048909:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee4:0x0]: returning size 260096 00000100:00100000:1.0:1715205776.048923:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c223dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+160:1831:x1798520455769344:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 136us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.048929:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4727 00010000:00010000:0.0:1715205776.049011:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170000/0xb608af430500771a lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2382b expref: 161 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.049022:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305007721 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2382b expref: 160 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.049027:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:0.0:1715205776.049029:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205776.049030:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099171680, rc 0) 00010000:00000080:0.0:1715205776.049034:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b6880 x1798520455769280/t330712482634(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.049099:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+160:11754:x1798520455769280:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1781us (1972us total) trans 330712482634 rc 0/0 00000100:00100000:0.0:1715205776.049104:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1894 00000100:00100000:2.0:1715205776.050256:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.050289:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455769408 00000100:00100000:0.0:1715205776.050313:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1895 00000100:00100000:0.0:1715205776.050317:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c225f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+160:11754:x1798520455769408:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.050329:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.050337:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af430500772f lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23832 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.050368:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007736 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.050376:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305007721 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2382b expref: 161 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.050381:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007736 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.050399:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305007721 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2382b expref: 161 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.050407:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305007721 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2382b expref: 161 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205776.050417:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456032704:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.050456:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b43c0 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.051264:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456032704:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.051274:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007736 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.051322:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.051392:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455769472 00010000:00010000:1.0:1715205776.051405:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305007721 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2382b expref: 162 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:1.0:1715205776.051428:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4728 00000100:00100000:1.0:1715205776.051431:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c222ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:1831:x1798520455769472:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1715205776.051442:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.051445:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305007721 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2382b expref: 162 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205776.051453:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305007721 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2382b expref: 162 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205776.051467:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305007721 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2382b expref: 162 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:1.0:1715205776.051475:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:1.0:1715205776.051477:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007736 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.051482:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007736 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.051488:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007736 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.051513:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205776.051543:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c222ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+161:1831:x1798520455769472:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 110us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.051548:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4728 00010000:00010000:0.0:1715205776.051615:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007736 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.051631:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007736 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.051651:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee4:0x0]: returning size 260096 00000004:00200000:0.0:1715205776.051654:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205776.051662:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007736 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.051667:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007736 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.051676:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800991721c0/0xb608af430500772f lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23832 expref: 161 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.051682:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007736 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23832 expref: 160 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.051687:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:0.0:1715205776.051689:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205776.051690:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099172f40, rc 0) 00010000:00000080:0.0:1715205776.051694:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c225f00 x1798520455769408/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.051712:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c225f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+160:11754:x1798520455769408:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1395us (1458us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.051717:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1895 00000100:00100000:3.0:1715205776.053438:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.053476:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455769600 00000100:00100000:0.0:1715205776.053562:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1896 00000100:00100000:0.0:1715205776.053566:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+160:11754:x1798520455769600:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.053578:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.053587:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af430500773d lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23839 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.053673:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007744 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.053684:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9440/0xb608af4305006e68 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234f1 expref: 161 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.053689:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007744 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.053706:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9440/0xb608af4305006e68 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234f1 expref: 161 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.053712:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9440/0xb608af4305006e68 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234f1 expref: 161 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205776.053719:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456032768:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.053764:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b43c0 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.055023:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456032768:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.055036:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007744 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.055064:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.055130:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455769664 00010000:00010000:2.0:1715205776.055147:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9440/0xb608af4305006e68 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234f1 expref: 162 pid: 14185 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205776.055175:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4729 00000100:00100000:2.0:1715205776.055177:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b04c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:1831:x1798520455769664:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1715205776.055184:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.055186:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9440/0xb608af4305006e68 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234f1 expref: 162 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205776.055192:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9440/0xb608af4305006e68 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234f1 expref: 162 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205776.055202:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9440/0xb608af4305006e68 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b234f1 expref: 162 pid: 14185 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205776.055233:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee5:0x0].0x0 (ffff8800a5d65a00) 00010000:00010000:2.0:1715205776.055237:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007744 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.055243:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007744 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.055248:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007744 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.055270:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.055297:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007744 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.055302:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b04c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+161:1831:x1798520455769664:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 123us (242us total) trans 0 rc 0/0 00010000:00010000:0.0:1715205776.055305:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007744 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.055309:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4729 00000004:00200000:0.0:1715205776.055318:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee5:0x0]: returning size 260096 00010000:00010000:0.0:1715205776.055413:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172ac0/0xb608af430500773d lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23839 expref: 162 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.055430:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007744 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23839 expref: 161 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.055435:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee5:0x0].0x0 (ffff8800a5d65a00) 00010000:00010000:0.0:1715205776.055437:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205776.055439:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099172d00, rc 0) 00010000:00000080:0.0:1715205776.055443:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b2600 x1798520455769600/t330712482635(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.055481:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+161:11754:x1798520455769600:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1914us (2046us total) trans 330712482635 rc 0/0 00000100:00100000:0.0:1715205776.055487:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1896 00000100:00100000:3.0:1715205776.057004:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.057047:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455769728 00000100:00100000:0.0:1715205776.057078:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1897 00000100:00100000:0.0:1715205776.057082:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b50c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+161:11754:x1798520455769728:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.057091:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.057099:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af4305007752 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23840 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.057132:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305007759 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.057140:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007744 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23839 expref: 162 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.057144:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305007759 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.057165:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007744 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23839 expref: 162 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.057173:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007744 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23839 expref: 162 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:0.0:1715205776.057182:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456032832:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.057221:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b43c0 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.058285:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456032832:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.058298:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305007759 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.058714:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.058814:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455769792 00010000:00010000:2.0:1715205776.058830:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007744 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23839 expref: 163 pid: 14860 timeout: 3135 lvb_type: 0 00000100:00100000:2.0:1715205776.058858:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4730 00000100:00100000:2.0:1715205776.058862:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b521d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+163:1831:x1798520455769792:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1715205776.058869:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.058872:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007744 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23839 expref: 163 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205776.058880:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007744 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23839 expref: 163 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205776.058891:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172d00/0xb608af4305007744 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23839 expref: 163 pid: 14860 timeout: 3135 lvb_type: 0 00010000:00010000:2.0:1715205776.058904:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee5:0x0].0x0 (ffff8800a5d65a00) 00010000:00010000:2.0:1715205776.058906:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305007759 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.058912:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305007759 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.058917:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305007759 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.058939:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.059006:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305007759 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.059012:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305007759 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.059035:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee5:0x0]: returning size 260096 00000004:00200000:0.0:1715205776.059037:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205776.059048:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305007759 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.059054:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305007759 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.059067:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170900/0xb608af4305007752 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23840 expref: 163 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.059081:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305007759 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23840 expref: 162 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.059086:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee5:0x0].0x0 (ffff8800a5d65a00) 00010000:00010000:0.0:1715205776.059088:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205776.059089:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099173600, rc 0) 00010000:00000080:0.0:1715205776.059092:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b50c0 x1798520455769728/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.059127:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b521d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:1831:x1798520455769792:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 264us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.059133:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4730 00000100:00100000:0.0:1715205776.059357:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b50c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+161:11754:x1798520455769728:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2274us (2356us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.059363:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1897 00000100:00100000:2.0:1715205776.060956:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.061020:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455769920 00000100:00100000:0.0:1715205776.061047:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1898 00000100:00100000:0.0:1715205776.061051:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c223dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+161:11754:x1798520455769920:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.061070:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.061079:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170000/0xb608af4305007760 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23847 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.061156:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305007767 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.061165:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006ea7 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23506 expref: 162 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.061170:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305007767 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.061192:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006ea7 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23506 expref: 162 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.061200:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006ea7 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23506 expref: 162 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.061208:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456032896:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.061251:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b43c0 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.061994:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456032896:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.062005:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305007767 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.062280:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.062328:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455769984 00010000:00010000:0.0:1715205776.062342:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006ea7 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23506 expref: 163 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.062367:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4731 00000100:00100000:0.0:1715205776.062371:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c222ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+163:1830:x1798520455769984:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205776.062378:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.062381:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006ea7 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23506 expref: 163 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.062388:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006ea7 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23506 expref: 163 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.062400:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9f80/0xb608af4305006ea7 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23506 expref: 163 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.062408:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee6:0x0].0x0 (ffff88008f367800) 00010000:00010000:0.0:1715205776.062411:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305007767 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.062416:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305007767 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.062421:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305007767 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.062439:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.062463:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c222ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:1830:x1798520455769984:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 92us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.062468:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4731 00010000:00010000:2.0:1715205776.062538:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305007767 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.062543:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305007767 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.062553:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee6:0x0]: returning size 260096 00010000:00010000:2.0:1715205776.062655:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170000/0xb608af4305007760 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23847 expref: 163 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.062664:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305007767 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23847 expref: 162 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.062674:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee6:0x0].0x0 (ffff88008f367800) 00010000:00010000:2.0:1715205776.062676:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.062677:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099172640, rc 0) 00010000:00000080:2.0:1715205776.062680:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c223dc0 x1798520455769920/t330712482636(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.062709:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c223dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:11754:x1798520455769920:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1657us (1754us total) trans 330712482636 rc 0/0 00000100:00100000:2.0:1715205776.062714:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1898 00000100:00100000:2.0:1715205776.063769:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.063845:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455770048 00000100:00100000:0.0:1715205776.063911:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1899 00000100:00100000:0.0:1715205776.063916:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c226880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:11754:x1798520455770048:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.063926:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.063933:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305007775 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2384e expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.063958:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500777c lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.063966:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305007767 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23847 expref: 163 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.063974:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500777c lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.063989:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305007767 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23847 expref: 163 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.063997:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305007767 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23847 expref: 163 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.064005:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456032960:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.064040:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b43c0 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.065017:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456032960:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.065028:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500777c lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.065211:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.065255:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455770112 00010000:00010000:0.0:1715205776.065268:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305007767 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23847 expref: 164 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.065294:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4732 00000100:00100000:0.0:1715205776.065297:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c222f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+164:1830:x1798520455770112:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1715205776.065303:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.065306:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305007767 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23847 expref: 164 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.065313:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305007767 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23847 expref: 164 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.065324:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172640/0xb608af4305007767 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23847 expref: 164 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.065333:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee6:0x0].0x0 (ffff88008f367800) 00010000:00010000:0.0:1715205776.065335:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500777c lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.065341:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500777c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.065346:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500777c lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.065369:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.065398:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c222f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+163:1830:x1798520455770112:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 99us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.065404:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4732 00010000:00010000:2.0:1715205776.065461:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500777c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.065474:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500777c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.065510:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee6:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.065514:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.065528:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500777c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.065537:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500777c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.065560:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170fc0/0xb608af4305007775 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2384e expref: 163 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.065579:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500777c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2384e expref: 162 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.065586:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee6:0x0].0x0 (ffff88008f367800) 00010000:00010000:2.0:1715205776.065588:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.065590:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880099170480, rc 0) 00010000:00000080:2.0:1715205776.065595:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c226880 x1798520455770048/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.065671:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c226880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:11754:x1798520455770048:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1754us (1902us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.065678:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1899 00000100:00100000:2.0:1715205776.067758:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.067822:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455770240 00000100:00100000:0.0:1715205776.067857:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1900 00000100:00100000:0.0:1715205776.067861:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c223900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:11754:x1798520455770240:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.067872:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.067882:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305007783 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23855 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.067939:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500778a lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.067950:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305006ee6 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2351b expref: 163 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.067956:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500778a lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.067975:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305006ee6 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2351b expref: 163 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.067983:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305006ee6 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2351b expref: 163 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.067997:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033024:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.068035:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008d2b43c0 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.070132:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033024:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.070148:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500778a lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.070159:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.070180:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455770304 00010000:00010000:0.0:1715205776.070196:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305006ee6 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2351b expref: 164 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.070221:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4733 00000100:00100000:0.0:1715205776.070224:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b2f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+164:1830:x1798520455770304:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1715205776.070231:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.070235:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305006ee6 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2351b expref: 164 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.070241:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305006ee6 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2351b expref: 164 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.070254:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305006ee6 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2351b expref: 164 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.070265:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee7:0x0].0x0 (ffff88008f367600) 00010000:00010000:0.0:1715205776.070267:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500778a lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.070273:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500778a lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.070278:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500778a lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.070302:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.070336:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b2f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+163:1830:x1798520455770304:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 110us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.070341:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4733 00010000:00010000:2.0:1715205776.070397:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500778a lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.070402:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500778a lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.070414:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee7:0x0]: returning size 260096 00010000:00010000:2.0:1715205776.070510:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099171680/0xb608af4305007783 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23855 expref: 164 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.070521:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500778a lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23855 expref: 163 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.070525:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee7:0x0].0x0 (ffff88008f367600) 00010000:00010000:2.0:1715205776.070527:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.070529:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59c6c0, rc 0) 00010000:00000080:2.0:1715205776.070532:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c223900 x1798520455770240/t330712482637(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.070551:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c223900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+163:11754:x1798520455770240:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2690us (2797us total) trans 330712482637 rc 0/0 00000100:00100000:2.0:1715205776.070556:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1900 00000100:00100000:3.0:1715205776.071846:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.071892:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455770368 00000100:00100000:2.0:1715205776.071921:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1901 00000100:00100000:2.0:1715205776.071924:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+163:11754:x1798520455770368:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.071935:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.071942:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af4305007798 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2385c expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.071968:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500779f lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.071975:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500778a lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23855 expref: 164 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.071979:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500779f lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.071995:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500778a lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23855 expref: 164 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.072002:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500778a lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23855 expref: 164 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.072010:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033088:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.072044:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.072888:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033088:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.072905:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500779f lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.072949:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.072969:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455770432 00010000:00010000:0.0:1715205776.072982:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500778a lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23855 expref: 165 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.073007:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4734 00000100:00100000:0.0:1715205776.073010:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b1c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+165:1830:x1798520455770432:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1715205776.073017:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.073021:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500778a lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23855 expref: 165 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.073031:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500778a lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23855 expref: 165 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.073040:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500778a lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23855 expref: 165 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.073048:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee7:0x0].0x0 (ffff88008f367600) 00010000:00010000:0.0:1715205776.073050:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500779f lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.073055:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500779f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.073059:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500779f lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.073083:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.073108:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b1c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+164:1830:x1798520455770432:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 96us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.073113:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4734 00010000:00010000:2.0:1715205776.073193:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500779f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.073200:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500779f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.073223:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee7:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.073226:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.073235:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500779f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.073241:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500779f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.073253:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af4305007798 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2385c expref: 164 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.073260:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500779f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2385c expref: 163 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.073265:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee7:0x0].0x0 (ffff88008f367600) 00010000:00010000:2.0:1715205776.073266:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.073268:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedc900, rc 0) 00010000:00000080:2.0:1715205776.073271:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b5f00 x1798520455770368/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.073312:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+163:11754:x1798520455770368:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1387us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.073317:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1901 00000100:00100000:3.0:1715205776.075183:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.075296:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455770560 00000100:00100000:2.0:1715205776.075329:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1902 00000100:00100000:2.0:1715205776.075333:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b0e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+163:11754:x1798520455770560:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.075345:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.075353:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af43050077a6 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23863 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.075410:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050077ad lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.075420:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006f25 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23530 expref: 164 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.075425:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050077ad lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.075443:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006f25 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23530 expref: 164 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.075451:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006f25 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23530 expref: 164 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.075459:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033152:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.075487:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.076223:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033152:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.076236:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050077ad lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.076332:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.076408:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455770624 00010000:00010000:0.0:1715205776.076422:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006f25 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23530 expref: 165 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.076447:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4735 00000100:00100000:0.0:1715205776.076451:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b5580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+165:1831:x1798520455770624:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205776.076458:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.076462:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006f25 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23530 expref: 165 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.076469:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006f25 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23530 expref: 165 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.076480:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305006f25 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23530 expref: 165 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.076492:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee8:0x0].0x0 (ffff88009399e700) 00010000:00010000:0.0:1715205776.076496:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050077ad lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.076501:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050077ad lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.076506:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050077ad lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.076528:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.076548:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b5580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+164:1831:x1798520455770624:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 97us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.076554:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4735 00010000:00010000:2.0:1715205776.076688:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050077ad lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.076694:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050077ad lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.076705:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee8:0x0]: returning size 260096 00010000:00010000:2.0:1715205776.076813:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af43050077a6 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23863 expref: 165 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.076822:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050077ad lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23863 expref: 164 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.076827:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee8:0x0].0x0 (ffff88009399e700) 00010000:00010000:2.0:1715205776.076829:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.076830:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eeddb00, rc 0) 00010000:00000080:2.0:1715205776.076834:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b0e40 x1798520455770560/t330712482638(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.076855:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b0e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+164:11754:x1798520455770560:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1522us (1675us total) trans 330712482638 rc 0/0 00000100:00100000:2.0:1715205776.076861:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1902 00000100:00100000:3.0:1715205776.077793:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.077834:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455770688 00000100:00100000:2.0:1715205776.077864:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1903 00000100:00100000:2.0:1715205776.077868:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+164:11754:x1798520455770688:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.077878:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.077885:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af43050077bb lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2386a expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.077913:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050077c2 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.077921:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050077ad lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23863 expref: 165 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.077926:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050077c2 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.077939:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050077ad lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23863 expref: 165 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.077946:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050077ad lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23863 expref: 165 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.077953:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033216:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.077988:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.079129:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033216:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.079140:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050077c2 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.079153:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.079185:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455770752 00010000:00010000:0.0:1715205776.079195:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050077ad lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23863 expref: 166 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.079220:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4736 00000100:00100000:0.0:1715205776.079224:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b4280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+166:1830:x1798520455770752:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1715205776.079233:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.079236:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050077ad lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23863 expref: 166 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.079242:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050077ad lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23863 expref: 166 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.079252:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050077ad lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23863 expref: 166 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.079259:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee8:0x0].0x0 (ffff88009399e700) 00010000:00010000:0.0:1715205776.079262:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050077c2 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.079266:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050077c2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.079271:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050077c2 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.079291:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.079316:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b4280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+165:1830:x1798520455770752:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 91us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.079322:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4736 00010000:00010000:2.0:1715205776.079347:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050077c2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.079353:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050077c2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.079371:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee8:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.079373:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.079383:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050077c2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.079389:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050077c2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.079401:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af43050077bb lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2386a expref: 165 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.079409:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050077c2 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2386a expref: 164 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.079413:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee8:0x0].0x0 (ffff88009399e700) 00010000:00010000:2.0:1715205776.079415:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.079416:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedeac0, rc 0) 00010000:00000080:2.0:1715205776.079420:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b04c0 x1798520455770688/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.079437:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+164:11754:x1798520455770688:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1570us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.079441:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1903 00000100:00100000:3.0:1715205776.080640:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.080701:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455770880 00000100:00100000:2.0:1715205776.080764:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1904 00000100:00100000:2.0:1715205776.080767:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+164:11754:x1798520455770880:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.080774:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.080783:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af43050077c9 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23871 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.080822:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050077d0 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.080830:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006f64 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23545 expref: 165 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.080834:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050077d0 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.080849:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006f64 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23545 expref: 165 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.080856:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006f64 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23545 expref: 165 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.080870:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033280:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.080934:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.081723:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033280:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.081734:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050077d0 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.081774:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.081814:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455770944 00010000:00010000:0.0:1715205776.081827:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006f64 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23545 expref: 166 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.081855:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4737 00000100:00100000:0.0:1715205776.081859:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5247850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+166:1830:x1798520455770944:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1715205776.081866:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.081870:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006f64 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23545 expref: 166 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.081877:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006f64 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23545 expref: 166 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.081887:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c06c0/0xb608af4305006f64 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23545 expref: 166 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.081896:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee9:0x0].0x0 (ffff88009399e100) 00010000:00010000:0.0:1715205776.081899:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050077d0 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.081905:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050077d0 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.081910:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050077d0 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.081932:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.081960:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5247850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+165:1830:x1798520455770944:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 100us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.081966:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4737 00010000:00010000:2.0:1715205776.081972:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050077d0 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.081980:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050077d0 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.081994:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee9:0x0]: returning size 260096 00010000:00010000:2.0:1715205776.082079:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af43050077c9 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23871 expref: 166 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.082088:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050077d0 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23871 expref: 165 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.082093:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee9:0x0].0x0 (ffff88009399e100) 00010000:00010000:2.0:1715205776.082095:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.082097:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedc6c0, rc 0) 00010000:00000080:2.0:1715205776.082100:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b0000 x1798520455770880/t330712482639(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.082136:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+165:11754:x1798520455770880:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1367us (1496us total) trans 330712482639 rc 0/0 00000100:00100000:2.0:1715205776.082141:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1904 00000100:00100000:3.0:1715205776.082990:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.083028:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455771008 00000100:00100000:2.0:1715205776.083056:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1905 00000100:00100000:2.0:1715205776.083060:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+165:11754:x1798520455771008:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.083068:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.083075:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af43050077de lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23878 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.083101:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af43050077e5 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.083108:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050077d0 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23871 expref: 166 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.083114:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af43050077e5 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.083128:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050077d0 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23871 expref: 166 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.083135:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050077d0 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23871 expref: 166 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.083142:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033344:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.083170:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.083885:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033344:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.083893:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af43050077e5 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.084023:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.084049:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455771072 00010000:00010000:0.0:1715205776.084058:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050077d0 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23871 expref: 167 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.084078:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4738 00000100:00100000:0.0:1715205776.084080:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b7200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:1831:x1798520455771072:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1715205776.084087:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.084089:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050077d0 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23871 expref: 167 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.084094:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050077d0 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23871 expref: 167 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.084100:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af43050077d0 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23871 expref: 167 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.084105:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee9:0x0].0x0 (ffff88009399e100) 00010000:00010000:0.0:1715205776.084107:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af43050077e5 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.084110:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af43050077e5 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.084113:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af43050077e5 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.084129:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.084143:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b7200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+166:1831:x1798520455771072:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 62us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.084148:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4738 00010000:00010000:2.0:1715205776.084199:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af43050077e5 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.084207:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af43050077e5 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.084226:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee9:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.084229:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.084240:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af43050077e5 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.084246:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af43050077e5 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.084260:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af43050077de lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23878 expref: 166 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.084269:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af43050077e5 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23878 expref: 165 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.084274:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee9:0x0].0x0 (ffff88009399e100) 00010000:00010000:2.0:1715205776.084276:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.084277:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedfa80, rc 0) 00010000:00000080:2.0:1715205776.084280:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b5a40 x1798520455771008/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.084310:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+165:11754:x1798520455771008:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1250us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.084316:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1905 00000100:00100000:3.0:1715205776.085427:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.085471:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455771200 00000100:00100000:2.0:1715205776.085497:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1906 00000100:00100000:2.0:1715205776.085501:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+165:11754:x1798520455771200:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.085508:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.085515:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af43050077ec lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2387f expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.085555:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050077f3 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.085564:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006fa3 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2355a expref: 166 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.085573:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050077f3 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.085588:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006fa3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2355a expref: 166 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.085595:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006fa3 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2355a expref: 166 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.085602:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033408:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.085656:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.086489:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033408:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.086499:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050077f3 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.086984:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.087005:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455771264 00010000:00010000:0.0:1715205776.087019:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006fa3 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2355a expref: 167 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.087042:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4739 00000100:00100000:0.0:1715205776.087046:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b1c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:1830:x1798520455771264:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205776.087052:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.087055:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006fa3 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2355a expref: 167 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.087062:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006fa3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2355a expref: 167 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.087072:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c8b40/0xb608af4305006fa3 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2355a expref: 167 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.087080:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeea:0x0].0x0 (ffff88012e817a00) 00010000:00010000:0.0:1715205776.087082:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050077f3 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.087088:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050077f3 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.087093:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050077f3 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.087111:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.087130:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b1c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+166:1830:x1798520455771264:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 83us (146us total) trans 0 rc 0/0 00010000:00010000:2.0:1715205776.087133:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050077f3 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.087135:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4739 00010000:00010000:2.0:1715205776.087139:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050077f3 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.087149:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeea:0x0]: returning size 260096 00010000:00010000:2.0:1715205776.087229:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af43050077ec lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2387f expref: 167 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.087238:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050077f3 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2387f expref: 166 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.087247:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeea:0x0].0x0 (ffff88012e817a00) 00010000:00010000:2.0:1715205776.087249:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.087250:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedef40, rc 0) 00010000:00000080:2.0:1715205776.087253:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b2f80 x1798520455771200/t330712482640(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.087274:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+166:11754:x1798520455771200:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1773us (1849us total) trans 330712482640 rc 0/0 00000100:00100000:2.0:1715205776.087278:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1906 00000100:00100000:3.0:1715205776.088056:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.088096:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455771328 00000100:00100000:2.0:1715205776.088124:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1907 00000100:00100000:2.0:1715205776.088127:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+166:11754:x1798520455771328:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.088137:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.088144:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af4305007801 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23886 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.088167:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305007808 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.088174:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050077f3 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2387f expref: 167 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.088178:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305007808 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.088188:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050077f3 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2387f expref: 167 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.088196:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050077f3 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2387f expref: 167 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.088201:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033472:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.088225:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.089179:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033472:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.089191:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305007808 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.089464:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.089574:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455771392 00010000:00010000:0.0:1715205776.089598:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050077f3 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2387f expref: 168 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.089652:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4740 00000100:00100000:1.0:1715205776.089657:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b4280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+168:1831:x1798520455771392:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1715205776.089666:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.089670:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050077f3 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2387f expref: 168 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.089676:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050077f3 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2387f expref: 168 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.089685:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050077f3 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2387f expref: 168 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.089694:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeea:0x0].0x0 (ffff88012e817a00) 00010000:00010000:1.0:1715205776.089696:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305007808 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.089700:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305007808 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.089703:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305007808 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.089710:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.089719:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305007808 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.089726:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305007808 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.089734:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b4280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:1831:x1798520455771392:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 78us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.089748:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4740 00000004:00200000:2.0:1715205776.089757:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeea:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.089759:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.089773:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305007808 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.089780:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305007808 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.089792:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af4305007801 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23886 expref: 167 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.089800:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305007808 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23886 expref: 166 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.089805:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeea:0x0].0x0 (ffff88012e817a00) 00010000:00010000:2.0:1715205776.089807:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.089808:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eede1c0, rc 0) 00010000:00000080:2.0:1715205776.089811:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b5580 x1798520455771328/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.089829:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+166:11754:x1798520455771328:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1702us (1775us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.089834:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1907 00000100:00100000:3.0:1715205776.091647:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.091690:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455771520 00000100:00100000:2.0:1715205776.091721:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1908 00000100:00100000:2.0:1715205776.091725:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1810980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+166:11754:x1798520455771520:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.091734:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.091757:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af430500780f lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2388d expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.091805:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007816 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.091814:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af43050072c1 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23679 expref: 167 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.091818:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007816 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.091835:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af43050072c1 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23679 expref: 167 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.091847:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af43050072c1 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23679 expref: 167 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.091855:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033536:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.091891:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.092507:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033536:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.092518:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007816 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.092635:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.092713:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455771584 00010000:00010000:1.0:1715205776.092750:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af43050072c1 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23679 expref: 168 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.092775:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4741 00000100:00100000:1.0:1715205776.092780:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a18163c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+168:1831:x1798520455771584:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1715205776.092791:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.092795:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af43050072c1 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23679 expref: 168 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.092804:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af43050072c1 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23679 expref: 168 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.092825:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1680/0xb608af43050072c1 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23679 expref: 168 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.092837:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:1.0:1715205776.092840:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007816 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.092848:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007816 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.092853:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007816 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.092879:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.092896:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007816 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.092903:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007816 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.092915:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeec:0x0]: returning size 260096 00000100:00100000:1.0:1715205776.092921:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a18163c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:1831:x1798520455771584:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 140us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.092927:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4741 00010000:00010000:2.0:1715205776.093040:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af430500780f lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2388d expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.093050:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007816 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2388d expref: 167 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.093056:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:2.0:1715205776.093058:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.093059:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedcb40, rc 0) 00010000:00000080:2.0:1715205776.093063:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1810980 x1798520455771520/t330712482641(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.093093:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1810980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455771520:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1367us (1447us total) trans 330712482641 rc 0/0 00000100:00100000:2.0:1715205776.093099:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1908 00000100:00100000:3.0:1715205776.093978:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.094014:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455771648 00000100:00100000:2.0:1715205776.094038:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1909 00000100:00100000:2.0:1715205776.094041:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455771648:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.094048:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.094054:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af4305007824 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23894 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.094073:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500782b lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.094078:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007816 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2388d expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.094082:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500782b lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.094093:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007816 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2388d expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.094098:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007816 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2388d expref: 168 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.094103:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033600:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.094134:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.095173:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033600:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.095184:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500782b lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.095190:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.095231:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455771712 00010000:00010000:1.0:1715205776.095246:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007816 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2388d expref: 169 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.095264:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4742 00000100:00100000:1.0:1715205776.095267:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1812ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+169:1831:x1798520455771712:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1715205776.095273:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.095275:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007816 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2388d expref: 169 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.095284:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007816 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2388d expref: 169 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.095292:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007816 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2388d expref: 169 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.095298:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:1.0:1715205776.095301:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500782b lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.095306:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500782b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.095309:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500782b lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.095328:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.095365:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500782b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.095371:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500782b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.095397:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1812ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+168:1831:x1798520455771712:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 127us (208us total) trans 0 rc 0/0 00000004:00200000:2.0:1715205776.095402:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeec:0x0]: returning size 260096 00000100:00100000:1.0:1715205776.095405:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4742 00000004:00200000:2.0:1715205776.095406:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.095425:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500782b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.095433:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500782b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.095451:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af4305007824 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23894 expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.095462:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500782b lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23894 expref: 167 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.095467:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:2.0:1715205776.095469:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.095471:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedc6c0, rc 0) 00010000:00000080:2.0:1715205776.095475:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1810000 x1798520455771648/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.095503:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455771648:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1461us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.095510:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1909 00000100:00100000:3.0:1715205776.096697:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.096750:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455771840 00000100:00100000:2.0:1715205776.096782:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1910 00000100:00100000:2.0:1715205776.096787:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a18176c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455771840:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.096799:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.096809:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007832 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2389b expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.096872:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007839 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.096881:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305007060 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23599 expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.096887:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007839 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.096909:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305007060 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23599 expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.096918:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305007060 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23599 expref: 168 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.096927:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033664:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.096969:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.097591:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033664:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.097604:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007839 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.097782:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.097830:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455771904 00010000:00010000:1.0:1715205776.097846:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305007060 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23599 expref: 169 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.097873:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4743 00000100:00100000:1.0:1715205776.097876:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1815a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+169:1830:x1798520455771904:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1715205776.097884:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.097889:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305007060 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23599 expref: 169 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.097896:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305007060 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23599 expref: 169 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.097906:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3600/0xb608af4305007060 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23599 expref: 169 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.097915:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeed:0x0].0x0 (ffff880092452f00) 00010000:00010000:1.0:1715205776.097917:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007839 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.097923:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007839 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.097927:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007839 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.097947:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.097969:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007839 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.097975:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1815a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+168:1830:x1798520455771904:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 97us (197us total) trans 0 rc 0/0 00010000:00010000:2.0:1715205776.097975:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007839 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.097981:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4743 00000004:00200000:2.0:1715205776.097984:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeed:0x0]: returning size 260096 00010000:00010000:2.0:1715205776.098087:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007832 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2389b expref: 169 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.098097:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007839 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2389b expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.098102:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeed:0x0].0x0 (ffff880092452f00) 00010000:00010000:2.0:1715205776.098104:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.098105:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fad8fc0, rc 0) 00010000:00000080:2.0:1715205776.098109:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a18176c0 x1798520455771840/t330712482642(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.098132:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a18176c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+168:11754:x1798520455771840:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1345us (1437us total) trans 330712482642 rc 0/0 00000100:00100000:2.0:1715205776.098138:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1910 00000100:00100000:3.0:1715205776.099069:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.099111:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455771968 00000100:00100000:2.0:1715205776.099134:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1911 00000100:00100000:2.0:1715205776.099137:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1813900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+168:11754:x1798520455771968:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.099145:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.099150:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007847 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b238a2 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.099178:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af430500784e lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.099186:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007839 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2389b expref: 169 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.099190:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af430500784e lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.099205:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007839 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2389b expref: 169 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.099213:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007839 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2389b expref: 169 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.099220:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033728:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.099254:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.100011:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033728:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.100022:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af430500784e lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.100030:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.100099:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455772032 00010000:00010000:1.0:1715205776.100111:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007839 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2389b expref: 170 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.100138:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4744 00000100:00100000:1.0:1715205776.100142:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5245850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+170:1830:x1798520455772032:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1715205776.100151:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.100154:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007839 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2389b expref: 170 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.100160:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007839 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2389b expref: 170 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.100170:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007839 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2389b expref: 170 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.100179:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeed:0x0].0x0 (ffff880092452f00) 00010000:00010000:1.0:1715205776.100181:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af430500784e lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.100186:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af430500784e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.100191:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af430500784e lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.100212:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.100234:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af430500784e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.100240:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5245850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+169:1830:x1798520455772032:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 97us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.100245:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4744 00010000:00010000:2.0:1715205776.100245:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af430500784e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.100265:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeed:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.100269:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.100281:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af430500784e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.100288:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af430500784e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.100303:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007847 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238a2 expref: 169 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.100311:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af430500784e lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238a2 expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.100316:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeed:0x0].0x0 (ffff880092452f00) 00010000:00010000:2.0:1715205776.100318:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.100319:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fadaac0, rc 0) 00010000:00000080:2.0:1715205776.100322:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1813900 x1798520455771968/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.100342:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1813900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+168:11754:x1798520455771968:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1204us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.100349:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1911 00000100:00100000:3.0:1715205776.101270:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.101350:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455772160 00000100:00100000:2.0:1715205776.101396:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1912 00000100:00100000:2.0:1715205776.101401:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1811c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+168:11754:x1798520455772160:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.101417:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.101432:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305007855 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b238a9 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.101495:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af430500785c lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.101506:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af430500709f lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235ae expref: 169 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.101511:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af430500785c lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.101534:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af430500709f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235ae expref: 169 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.101542:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af430500709f lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235ae expref: 169 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.101550:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033792:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.101600:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.102309:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033792:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.102324:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af430500785c lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.102459:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.102529:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455772224 00010000:00010000:1.0:1715205776.102544:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af430500709f lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235ae expref: 170 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.102572:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4745 00000100:00100000:1.0:1715205776.102576:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a18104c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+170:1831:x1798520455772224:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1715205776.102584:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.102587:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af430500709f lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235ae expref: 170 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.102595:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af430500709f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235ae expref: 170 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.102606:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1200/0xb608af430500709f lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235ae expref: 170 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.102637:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeee:0x0].0x0 (ffff8800b410f900) 00010000:00010000:1.0:1715205776.102640:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af430500785c lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.102647:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af430500785c lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.102652:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af430500785c lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.102667:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205776.102688:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a18104c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+169:1831:x1798520455772224:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 111us (231us total) trans 0 rc 0/0 00010000:00010000:2.0:1715205776.102688:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af430500785c lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.102694:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4745 00010000:00010000:2.0:1715205776.102694:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af430500785c lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.102705:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeee:0x0]: returning size 260096 00010000:00010000:2.0:1715205776.102804:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305007855 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238a9 expref: 170 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.102819:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af430500785c lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238a9 expref: 169 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.102824:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeee:0x0].0x0 (ffff8800b410f900) 00010000:00010000:2.0:1715205776.102826:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.102827:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fad8900, rc 0) 00010000:00000080:2.0:1715205776.102831:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1811c80 x1798520455772160/t330712482643(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.102855:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1811c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+169:11754:x1798520455772160:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1454us (1589us total) trans 330712482643 rc 0/0 00000100:00100000:2.0:1715205776.102861:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1912 00000100:00100000:3.0:1715205776.104320:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.104380:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455772288 00000100:00100000:2.0:1715205776.104414:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1913 00000100:00100000:2.0:1715205776.104418:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1811300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+169:11754:x1798520455772288:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.104427:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.104435:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af430500786a lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b238b0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.104461:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007871 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.104469:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af430500785c lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238a9 expref: 170 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.104473:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007871 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.104492:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af430500785c lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238a9 expref: 170 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.104499:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af430500785c lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238a9 expref: 170 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.104507:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033856:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.104541:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.105452:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033856:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.105464:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007871 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.105663:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.105727:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455772352 00010000:00010000:1.0:1715205776.105753:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af430500785c lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238a9 expref: 171 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.105785:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4746 00000100:00100000:1.0:1715205776.105789:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1814740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:1830:x1798520455772352:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1715205776.105797:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.105800:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af430500785c lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238a9 expref: 171 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.105807:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af430500785c lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238a9 expref: 171 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.105819:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af430500785c lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238a9 expref: 171 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.105827:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeee:0x0].0x0 (ffff8800b410f900) 00010000:00010000:1.0:1715205776.105829:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007871 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.105835:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007871 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.105840:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007871 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.105859:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205776.105879:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1814740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+170:1830:x1798520455772352:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 89us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.105885:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4746 00010000:00010000:2.0:1715205776.105888:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007871 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.105896:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007871 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.105919:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeee:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.105922:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.105932:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007871 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.105939:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007871 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.105953:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af430500786a lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238b0 expref: 170 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.105967:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007871 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238b0 expref: 169 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.105972:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeee:0x0].0x0 (ffff8800b410f900) 00010000:00010000:2.0:1715205776.105986:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.105987:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fadb180, rc 0) 00010000:00000080:2.0:1715205776.105991:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1811300 x1798520455772288/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.106015:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1811300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+169:11754:x1798520455772288:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1597us (1697us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.106020:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1913 00000100:00100000:3.0:1715205776.107299:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.107368:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455772480 00000100:00100000:2.0:1715205776.107400:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1914 00000100:00100000:2.0:1715205776.107404:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1810e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+169:11754:x1798520455772480:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.107420:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.107429:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8480/0xb608af4305007878 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b238b7 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.107472:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af430500787f lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.107481:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af43050070de lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235c3 expref: 170 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.107485:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af430500787f lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.107511:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af43050070de lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235c3 expref: 170 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.107519:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af43050070de lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235c3 expref: 170 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.107528:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033920:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.107557:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.108655:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033920:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.108667:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af430500787f lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.108879:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.108967:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455772544 00010000:00010000:0.0:1715205776.108980:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af43050070de lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235c3 expref: 171 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.109001:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4747 00000100:00100000:0.0:1715205776.109005:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1815f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:1830:x1798520455772544:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205776.109011:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.109014:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af43050070de lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235c3 expref: 171 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.109020:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af43050070de lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235c3 expref: 171 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.109031:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099173a80/0xb608af43050070de lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235c3 expref: 171 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.109045:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeef:0x0].0x0 (ffff880129f26800) 00010000:00010000:0.0:1715205776.109048:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af430500787f lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.109054:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af430500787f lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.109059:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af430500787f lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.109080:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.109098:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1815f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+170:1830:x1798520455772544:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 92us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.109103:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4747 00010000:00010000:2.0:1715205776.109114:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af430500787f lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.109122:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af430500787f lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.109137:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeef:0x0]: returning size 260096 00010000:00010000:2.0:1715205776.109230:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8480/0xb608af4305007878 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238b7 expref: 171 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.109240:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af430500787f lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238b7 expref: 170 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.109246:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeef:0x0].0x0 (ffff880129f26800) 00010000:00010000:2.0:1715205776.109247:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.109249:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fad9680, rc 0) 00010000:00000080:2.0:1715205776.109253:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1810e40 x1798520455772480/t330712482644(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.109283:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1810e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+170:11754:x1798520455772480:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1878us (1985us total) trans 330712482644 rc 0/0 00000100:00100000:2.0:1715205776.109289:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1914 00000100:00100000:3.0:1715205776.110159:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.110196:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455772608 00000100:00100000:2.0:1715205776.110217:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1915 00000100:00100000:2.0:1715205776.110220:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1812140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+170:11754:x1798520455772608:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.110229:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.110235:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af430500788d lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b238be expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.110261:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007894 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.110269:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af430500787f lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238b7 expref: 171 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.110274:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007894 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.110290:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af430500787f lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238b7 expref: 171 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.110298:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af430500787f lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238b7 expref: 171 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.110306:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033984:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.110344:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.111227:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456033984:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.111238:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007894 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.111350:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.111497:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455772672 00010000:00010000:0.0:1715205776.111512:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af430500787f lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238b7 expref: 172 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.111543:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4748 00000100:00100000:0.0:1715205776.111547:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1816880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+172:1830:x1798520455772672:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1715205776.111554:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.111557:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af430500787f lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238b7 expref: 172 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.111564:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af430500787f lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238b7 expref: 172 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.111576:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af430500787f lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238b7 expref: 172 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.111584:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeef:0x0].0x0 (ffff880129f26800) 00010000:00010000:0.0:1715205776.111587:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007894 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.111593:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007894 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.111602:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007894 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.111635:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.111642:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007894 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.111648:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007894 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.111666:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1816880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:1830:x1798520455772672:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 118us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.111672:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4748 00000004:00200000:2.0:1715205776.111673:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeef:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.111676:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.111687:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007894 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.111694:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007894 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.111817:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af430500788d lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238be expref: 171 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.111827:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007894 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238be expref: 170 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.111832:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeef:0x0].0x0 (ffff880129f26800) 00010000:00010000:2.0:1715205776.111834:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.111835:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fada400, rc 0) 00010000:00000080:2.0:1715205776.111838:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1812140 x1798520455772608/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.111863:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1812140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+170:11754:x1798520455772608:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1642us (1705us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.111869:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1915 00000100:00100000:3.0:1715205776.113173:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.113214:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455772800 00000100:00100000:2.0:1715205776.113244:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1916 00000100:00100000:2.0:1715205776.113248:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1812600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+170:11754:x1798520455772800:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.113258:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.113266:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af430500789b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b238c5 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.113317:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af43050078a2 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.113327:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af430500711d lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235d8 expref: 171 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.113332:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af43050078a2 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.113348:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af430500711d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235d8 expref: 171 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.113354:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af430500711d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235d8 expref: 171 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.113360:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034048:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.113389:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.114320:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.114367:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455772864 00000100:00100000:2.0:1715205776.114386:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034048:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.114397:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af430500711d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235d8 expref: 172 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.114397:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af43050078a2 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.114433:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4749 00000100:00100000:0.0:1715205776.114438:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1812f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+172:1831:x1798520455772864:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1715205776.114450:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.114454:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af430500711d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235d8 expref: 172 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.114462:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af430500711d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235d8 expref: 172 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.114477:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172400/0xb608af430500711d lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b235d8 expref: 172 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.114490:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef0:0x0].0x0 (ffff88009c8aab00) 00010000:00010000:0.0:1715205776.114493:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af43050078a2 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.114501:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af43050078a2 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.114505:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af43050078a2 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.114531:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.114575:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1812f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:1831:x1798520455772864:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 137us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.114581:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4749 00010000:00010000:2.0:1715205776.114640:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af43050078a2 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.114647:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af43050078a2 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.114663:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xef0:0x0]: returning size 260096 00010000:00010000:2.0:1715205776.114805:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af430500789b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238c5 expref: 172 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.114818:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af43050078a2 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238c5 expref: 171 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.114823:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef0:0x0].0x0 (ffff88009c8aab00) 00010000:00010000:2.0:1715205776.114825:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.114826:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fad8b40, rc 0) 00010000:00000080:2.0:1715205776.114831:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1812600 x1798520455772800/t330712482645(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.114869:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1812600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:11754:x1798520455772800:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1621us (1697us total) trans 330712482645 rc 0/0 00000100:00100000:2.0:1715205776.114875:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1916 00000100:00100000:3.0:1715205776.116591:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.116676:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455772928 00000100:00100000:2.0:1715205776.116716:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1917 00000100:00100000:2.0:1715205776.116721:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a18117c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:11754:x1798520455772928:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.116750:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.116763:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af43050078b0 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b238cc expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.116805:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af43050078b7 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.116815:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af43050078a2 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238c5 expref: 172 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.116819:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af43050078b7 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.116844:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af43050078a2 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238c5 expref: 172 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.116853:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af43050078a2 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238c5 expref: 172 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.116863:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034112:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.116916:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.117705:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034112:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.117722:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af43050078b7 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.117904:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.117965:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455772992 00010000:00010000:0.0:1715205776.117989:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af43050078a2 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238c5 expref: 173 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.118024:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4750 00000100:00100000:0.0:1715205776.118028:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1814280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+173:1831:x1798520455772992:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1715205776.118039:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.118044:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af43050078a2 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238c5 expref: 173 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.118050:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af43050078a2 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238c5 expref: 173 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.118062:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af43050078a2 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238c5 expref: 173 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.118072:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef0:0x0].0x0 (ffff88009c8aab00) 00010000:00010000:0.0:1715205776.118075:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af43050078b7 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.118079:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af43050078b7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.118083:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af43050078b7 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.118105:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.118127:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af43050078b7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.118134:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af43050078b7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.118144:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1814280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+172:1831:x1798520455772992:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 115us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.118149:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4750 00000004:00200000:2.0:1715205776.118163:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xef0:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.118166:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.118258:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af43050078b7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.118267:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af43050078b7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.118285:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af43050078b0 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238cc expref: 172 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.118296:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af43050078b7 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238cc expref: 171 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.118301:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef0:0x0].0x0 (ffff88009c8aab00) 00010000:00010000:2.0:1715205776.118303:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.118305:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fada640, rc 0) 00010000:00000080:2.0:1715205776.118309:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a18117c0 x1798520455772928/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.118332:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a18117c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:11754:x1798520455772928:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1611us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.118337:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1917 00000100:00100000:3.0:1715205776.119607:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.120047:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455773120 00000100:00100000:2.0:1715205776.120086:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1918 00000100:00100000:2.0:1715205776.120090:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1814c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:11754:x1798520455773120:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.120103:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.120114:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af43050078be lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b238d3 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.120169:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af43050078c5 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.120178:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006fe2 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2356f expref: 172 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.120183:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af43050078c5 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.120202:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006fe2 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2356f expref: 172 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.120209:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006fe2 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2356f expref: 172 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.120217:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034176:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.120260:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.121241:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034176:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.121260:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af43050078c5 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.121558:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.121638:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455773184 00010000:00010000:0.0:1715205776.121657:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006fe2 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2356f expref: 173 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.121684:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4751 00000100:00100000:0.0:1715205776.121688:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5240050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+173:1831:x1798520455773184:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205776.121696:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.121699:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006fe2 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2356f expref: 173 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.121706:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006fe2 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2356f expref: 173 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.121719:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c98c0/0xb608af4305006fe2 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2356f expref: 173 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.121732:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeeb:0x0].0x0 (ffff88008f367f00) 00010000:00010000:0.0:1715205776.121734:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af43050078c5 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.121748:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af43050078c5 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.121754:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af43050078c5 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.121774:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.121794:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5240050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+172:1831:x1798520455773184:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 106us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.121799:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4751 00010000:00010000:2.0:1715205776.121867:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af43050078c5 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.121873:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af43050078c5 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.121889:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeeb:0x0]: returning size 260096 00010000:00010000:2.0:1715205776.121996:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af43050078be lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238d3 expref: 173 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.122006:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af43050078c5 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238d3 expref: 172 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.122011:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeeb:0x0].0x0 (ffff88008f367f00) 00010000:00010000:2.0:1715205776.122013:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.122015:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fad8d80, rc 0) 00010000:00000080:2.0:1715205776.122018:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1814c00 x1798520455773120/t330712482646(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.122051:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1814c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+172:11754:x1798520455773120:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1960us (2447us total) trans 330712482646 rc 0/0 00000100:00100000:2.0:1715205776.122056:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1918 00000100:00100000:3.0:1715205776.123478:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.123566:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455773248 00000100:00100000:2.0:1715205776.123615:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1919 00000100:00100000:2.0:1715205776.123640:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1813440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+172:11754:x1798520455773248:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.123658:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.123673:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af43050078d3 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b238da expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.123721:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af43050078da lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.123732:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af43050078c5 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238d3 expref: 173 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.123752:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af43050078da lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.123780:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af43050078c5 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238d3 expref: 173 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.123790:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af43050078c5 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238d3 expref: 173 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.123800:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034240:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.123897:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.124898:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.124936:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455773312 00010000:00010000:0.0:1715205776.124951:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af43050078c5 lrc: 5/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238d3 expref: 174 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.124975:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4752 00000100:00100000:0.0:1715205776.124978:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1817200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+174:1830:x1798520455773312:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00000100:00100000:2.0:1715205776.124978:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034240:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.124984:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.124987:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af43050078c5 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238d3 expref: 174 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.124994:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af43050078c5 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238d3 expref: 174 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.125098:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af43050078da lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.125105:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af43050078c5 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238d3 expref: 174 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.125121:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeeb:0x0].0x0 (ffff88008f367f00) 00010000:00010000:0.0:1715205776.125124:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af43050078da lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.125130:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af43050078da lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.125136:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af43050078da lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.125160:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.125196:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1817200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+173:1830:x1798520455773312:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 216us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.125202:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4752 00010000:00010000:2.0:1715205776.125404:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af43050078da lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.125411:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af43050078da lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.125441:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeeb:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.125444:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.125457:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af43050078da lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.125465:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af43050078da lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.125486:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af43050078d3 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238da expref: 173 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.125500:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af43050078da lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238da expref: 172 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.125505:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeeb:0x0].0x0 (ffff88008f367f00) 00010000:00010000:2.0:1715205776.125507:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.125509:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fadaf40, rc 0) 00010000:00000080:2.0:1715205776.125513:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1813440 x1798520455773248/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.125555:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1813440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+172:11754:x1798520455773248:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1915us (2084us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.125562:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1919 00000100:00100000:3.0:1715205776.127424:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.127500:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455773440 00000100:00100000:0.0:1715205776.127540:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 509 00000100:00100000:0.0:1715205776.127544:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1816d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+172:11754:x1798520455773440:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205776.127781:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1816d40 x1798520455773440/t330712482647(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.127824:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1816d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+173:11754:x1798520455773440:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 279us (404us total) trans 330712482647 rc 0/0 00000100:00100000:0.0:1715205776.127831:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 509 00000100:00100000:3.0:1715205776.129427:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.129997:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455773568 00000100:00100000:2.0:1715205776.130037:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1920 00000100:00100000:2.0:1715205776.130042:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a18104c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+173:11754:x1798520455773568:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.130058:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.130073:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af43050078e1 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b238e1 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.130131:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050078e8 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.130145:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500724a lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23648 expref: 174 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.130155:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050078e8 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.130180:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500724a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23648 expref: 174 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.130198:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500724a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23648 expref: 174 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.130207:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034304:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.130325:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.132082:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034304:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.132100:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050078e8 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.132679:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.132755:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455773632 00010000:00010000:0.0:1715205776.132787:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500724a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23648 expref: 175 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.132824:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4753 00000100:00100000:0.0:1715205776.132829:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1814740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+175:1831:x1798520455773632:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1715205776.132842:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.132847:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500724a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23648 expref: 175 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.132857:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500724a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23648 expref: 175 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.132877:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c18c0/0xb608af430500724a lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23648 expref: 175 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.132889:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1010:0x0].0x0 (ffff880129f26000) 00010000:00010000:0.0:1715205776.132894:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050078e8 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.132902:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050078e8 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.132909:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050078e8 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.132940:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.132988:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1814740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+174:1831:x1798520455773632:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 159us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.132995:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4753 00010000:00010000:2.0:1715205776.133031:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050078e8 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.133038:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050078e8 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.133054:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1010:0x0]: returning size 4096 00010000:00010000:2.0:1715205776.133160:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af43050078e1 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238e1 expref: 175 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.133189:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050078e8 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238e1 expref: 174 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.133200:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1010:0x0].0x0 (ffff880129f26000) 00010000:00010000:2.0:1715205776.133202:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.133204:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fadb600, rc 0) 00010000:00000080:2.0:1715205776.133207:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a18104c0 x1798520455773568/t330712482648(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.133240:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a18104c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+174:11754:x1798520455773568:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 3198us (3816us total) trans 330712482648 rc 0/0 00000100:00100000:2.0:1715205776.133247:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1920 00000100:00100000:3.0:1715205776.135410:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.135489:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455773696 00000100:00100000:2.0:1715205776.135529:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1921 00000100:00100000:2.0:1715205776.135533:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1815f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+174:11754:x1798520455773696:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.135549:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.135560:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af43050078f6 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b238e8 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.135599:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af43050078fd lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.135609:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050078e8 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238e1 expref: 175 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.135614:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af43050078fd lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.135665:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050078e8 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238e1 expref: 175 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.135677:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050078e8 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238e1 expref: 175 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.135685:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034368:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.135723:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.137615:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034368:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.137652:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af43050078fd lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.137689:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.137709:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455773760 00010000:00010000:0.0:1715205776.137731:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050078e8 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238e1 expref: 176 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.137770:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4754 00000100:00100000:0.0:1715205776.137775:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1816880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+176:1830:x1798520455773760:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1715205776.137784:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.137787:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050078e8 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238e1 expref: 176 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.137795:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050078e8 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238e1 expref: 176 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.137809:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050078e8 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238e1 expref: 176 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.138045:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1010:0x0].0x0 (ffff880129f26000) 00010000:00010000:0.0:1715205776.138049:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af43050078fd lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.138055:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af43050078fd lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.138060:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af43050078fd lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.138084:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.138121:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1816880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+175:1830:x1798520455773760:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 346us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.138130:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4754 00010000:00010000:2.0:1715205776.138710:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af43050078fd lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.138718:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af43050078fd lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.138759:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1010:0x0]: returning size 4096 00000004:00200000:2.0:1715205776.138762:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.138774:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af43050078fd lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.138781:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af43050078fd lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.138799:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af43050078f6 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238e8 expref: 175 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.138810:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af43050078fd lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238e8 expref: 174 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.138816:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1010:0x0].0x0 (ffff880129f26000) 00010000:00010000:2.0:1715205776.138818:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.138819:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fad9d40, rc 0) 00010000:00000080:2.0:1715205776.138824:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1815f00 x1798520455773696/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.138865:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1815f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+174:11754:x1798520455773696:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 3331us (3458us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.138871:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1921 00000100:00100000:3.0:1715205776.140824:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.140888:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455773888 00000100:00100000:0.0:1715205776.140926:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 510 00000100:00100000:0.0:1715205776.140931:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1812f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+174:11754:x1798520455773888:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205776.141112:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1812f80 x1798520455773888/t330712482649(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.141168:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1812f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+175:11754:x1798520455773888:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 236us (349us total) trans 330712482649 rc 0/0 00000100:00100000:0.0:1715205776.141180:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 510 00000100:00100000:3.0:1715205776.144117:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.144212:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455774016 00000100:00100000:1.0:1715205776.144316:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 511 00000100:00100000:1.0:1715205776.144321:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1814280 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+175:11754:x1798520455774016:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.144463:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1814280 x1798520455774016/t330712482650(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.144506:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1814280 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+176:11754:x1798520455774016:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 184us (395us total) trans 330712482650 rc 0/0 00000100:00100000:1.0:1715205776.144514:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 511 00000100:00100000:3.0:1715205776.145582:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.145645:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455774144 00000100:00100000:1.0:1715205776.145690:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 512 00000100:00100000:1.0:1715205776.145695:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a18163c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+176:11754:x1798520455774144:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.145832:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a18163c0 x1798520455774144/t330712482651(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.145875:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a18163c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+177:11754:x1798520455774144:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 180us (298us total) trans 330712482651 rc 0/0 00000100:00100000:1.0:1715205776.145881:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 512 00000100:00100000:3.0:1715205776.146917:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.147225:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455774272 00000100:00100000:1.0:1715205776.147269:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 513 00000100:00100000:1.0:1715205776.147274:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c05050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+177:11754:x1798520455774272:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.147387:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880093c05050 x1798520455774272/t330712482652(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.147593:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c05050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+178:11754:x1798520455774272:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 318us (677us total) trans 330712482652 rc 0/0 00000100:00100000:1.0:1715205776.147599:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 513 00000100:00100000:3.0:1715205776.148616:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.148694:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455774400 00000100:00100000:1.0:1715205776.148784:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 514 00000100:00100000:1.0:1715205776.148788:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1812ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+178:11754:x1798520455774400:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.148868:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1812ac0 x1798520455774400/t330712482653(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.149011:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1812ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+179:11754:x1798520455774400:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 222us (396us total) trans 330712482653 rc 0/0 00000100:00100000:1.0:1715205776.149017:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 514 00000100:00100000:3.0:1715205776.149901:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.149948:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455774528 00000100:00100000:1.0:1715205776.149970:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 515 00000100:00100000:1.0:1715205776.149973:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1815a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+179:11754:x1798520455774528:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.150032:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1815a40 x1798520455774528/t330712482654(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.150057:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1815a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+180:11754:x1798520455774528:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 83us (157us total) trans 330712482654 rc 0/0 00000100:00100000:1.0:1715205776.150062:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 515 00000100:00100000:3.0:1715205776.151402:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.151464:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455774656 00000100:00100000:1.0:1715205776.151546:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 516 00000100:00100000:1.0:1715205776.151551:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1816d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+180:11754:x1798520455774656:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.151652:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1816d40 x1798520455774656/t330712482655(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.151717:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1816d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+181:11754:x1798520455774656:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 166us (317us total) trans 330712482655 rc 0/0 00000100:00100000:1.0:1715205776.151723:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 516 00000100:00100000:3.0:1715205776.153004:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.153361:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455774784 00000100:00100000:1.0:1715205776.153391:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 517 00000100:00100000:1.0:1715205776.153395:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1812f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+181:11754:x1798520455774784:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.153487:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1812f80 x1798520455774784/t330712482656(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.153530:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1812f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+182:11754:x1798520455774784:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 134us (528us total) trans 330712482656 rc 0/0 00000100:00100000:1.0:1715205776.153535:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 517 00000100:00100000:3.0:1715205776.154386:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.154421:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455774912 00000100:00100000:1.0:1715205776.154448:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 518 00000100:00100000:1.0:1715205776.154452:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1814280 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+182:11754:x1798520455774912:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.154507:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1814280 x1798520455774912/t330712482657(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.154537:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1814280 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+183:11754:x1798520455774912:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 84us (150us total) trans 330712482657 rc 0/0 00000100:00100000:1.0:1715205776.154542:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 518 00000100:00100000:3.0:1715205776.156164:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.156230:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455775040 00000100:00100000:1.0:1715205776.156300:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 519 00000100:00100000:1.0:1715205776.156304:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c07050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+183:11754:x1798520455775040:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.156396:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880093c07050 x1798520455775040/t330712482658(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.156482:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c07050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+184:11754:x1798520455775040:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 177us (320us total) trans 330712482658 rc 0/0 00000100:00100000:1.0:1715205776.156488:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 519 00000100:00100000:3.0:1715205776.157784:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.158134:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455775168 00000100:00100000:1.0:1715205776.158182:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 520 00000100:00100000:1.0:1715205776.158187:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a18163c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+184:11754:x1798520455775168:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.158338:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a18163c0 x1798520455775168/t330712482659(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.158471:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a18163c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+185:11754:x1798520455775168:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 280us (688us total) trans 330712482659 rc 0/0 00000100:00100000:1.0:1715205776.158481:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 520 00000100:00100000:3.0:1715205776.162943:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.163044:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455775296 00000100:00100000:1.0:1715205776.163091:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 521 00000100:00100000:1.0:1715205776.163096:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1812ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+185:11754:x1798520455775296:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.163267:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1812ac0 x1798520455775296/t330712482660(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.163312:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1812ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+186:11754:x1798520455775296:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 215us (373us total) trans 330712482660 rc 0/0 00000100:00100000:1.0:1715205776.163318:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 521 00000100:00100000:3.0:1715205776.164572:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.164642:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455775424 00000100:00100000:1.0:1715205776.164678:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 522 00000100:00100000:1.0:1715205776.164682:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1815a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+186:11754:x1798520455775424:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.164774:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1815a40 x1798520455775424/t330712482661(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.164810:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1815a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:11754:x1798520455775424:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 128us (241us total) trans 330712482661 rc 0/0 00000100:00100000:1.0:1715205776.164816:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 522 00000100:00100000:3.0:1715205776.167835:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.168005:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455775552 00000100:00100000:1.0:1715205776.168043:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 523 00000100:00100000:1.0:1715205776.168047:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1816d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:11754:x1798520455775552:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.168148:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1816d40 x1798520455775552/t330712482662(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.168189:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1816d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+188:11754:x1798520455775552:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 141us (356us total) trans 330712482662 rc 0/0 00000100:00100000:1.0:1715205776.168195:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 523 00000100:00100000:3.0:1715205776.170521:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.170714:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455775680 00000100:00100000:1.0:1715205776.170786:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 524 00000100:00100000:1.0:1715205776.170790:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1812f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+188:11754:x1798520455775680:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.170952:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1812f80 x1798520455775680/t330712482663(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.171009:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1812f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+189:11754:x1798520455775680:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 218us (490us total) trans 330712482663 rc 0/0 00000100:00100000:1.0:1715205776.171015:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 524 00000100:00100000:3.0:1715205776.173669:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.173771:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455775808 00000100:00100000:1.0:1715205776.173826:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 525 00000100:00100000:1.0:1715205776.173831:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c03050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+189:11754:x1798520455775808:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.173973:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880093c03050 x1798520455775808/t330712482664(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.174035:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c03050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+190:11754:x1798520455775808:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 203us (371us total) trans 330712482664 rc 0/0 00000100:00100000:1.0:1715205776.174041:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 525 00000100:00100000:3.0:1715205776.175810:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.175897:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455775936 00000100:00100000:2.0:1715205776.175937:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1922 00000100:00100000:2.0:1715205776.175940:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1814280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+190:11754:x1798520455775936:12345-192.168.204.8@tcp:36:dbench.0 00010000:00010000:2.0:1715205776.175988:0:14860:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1715205776.176014:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af43050078fd lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238e8 expref: 190 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.176052:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af43050071e1 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23617 expref: 189 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.176062:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1010:0x0].0x0 (ffff880129f26000) 00010000:00010000:2.0:1715205776.176076:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af43050076e9 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23816 expref: 188 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.176082:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.176084:0:14860:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.176108:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af4305007904 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.176121:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af4305007904 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.176129:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af4305007904 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.176139:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af430500790b lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.176144:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af430500790b lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.176149:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af430500790b lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.176261:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007912 lrc: 3/0,1 mode: --/EX res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.176267:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007912 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.176273:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007912 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1715205776.176700:0:14860:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x136:0x0].67, 64 off12480 00010000:00010000:2.0:1715205776.176796:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007919 lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.176809:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007919 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.176819:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007919 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.176825:0:14860:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007919 lrc: 4/0,1 mode: PW/PW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.176829:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007919 lrc: 4/0,1 mode: PW/PW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.176833:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007919 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.176970:0:14860:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1715205776.176982:0:8314:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00010000:2.0:1715205776.176987:0:14860:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff8800a1814280 reply state ffff880090efa000 transno 330712482665 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007912 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.176988:0:8314:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007919 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446612134800702224 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.176995:0:8314:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009fad8240 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:0.0:1715205776.176998:0:8314:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007919 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.177005:0:8314:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007919 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.177013:0:8314:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1010:0x0].0x0 (ffff880092bfc100) 00010000:00010000:0.0:1715205776.177016:0:8314:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1715205776.177018:0:8314:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007919 lrc: 1/0,0 mode: --/PW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.177022:0:8314:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007919 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.177030:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af4305007904 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.177034:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af4305007904 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.177037:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af4305007904 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.177041:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009fada1c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.177043:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af4305007904 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.177046:0:8314:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205776.177050:0:8314:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205776.177051:0:8314:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715205776.177051:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af4305007904 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.177059:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.177061:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.177063:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af4305007904 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.177067:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af4305007904 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1715205776.177074:0:14860:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff8800a1814280 reply state ffff880090efa000 transno 330712482665 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af430500790b lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00000080:2.0:1715205776.177092:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1814280 x1798520455775936/t330712482665(0) o36->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 504/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.177152:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1814280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+189:11754:x1798520455775936:12345-192.168.204.8@tcp:36:dbench.0 Request processed in 1210us (1344us total) trans 330712482665 rc 0/0 00000100:00100000:2.0:1715205776.177159:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1922 00010000:00010000:2.0:1715205776.180487:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af430500790b lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.180500:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af430500790b lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.180506:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af430500790b lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.180515:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009fad8b40 already unused, calling callback (ffffffffa1341360) 00000100:00100000:3.0:1715205776.180516:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:2.0:1715205776.180518:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af430500790b lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.180524:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af430500790b lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.180608:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455776064 00000100:00100000:1.0:1715205776.180672:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 526 00000100:00100000:1.0:1715205776.180677:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a18163c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+189:11754:x1798520455776064:12345-192.168.204.8@tcp:35:dbench.0 00010000:00010000:2.0:1715205776.180758:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x522b8500 (ffff880092bfc000) 00010000:00010000:2.0:1715205776.180761:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.180764:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af430500790b lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.180768:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af430500790b lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.180785:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007912 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.180840:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007912 lrc: 2/0,0 mode: EX/EX res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.180846:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007912 lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.180850:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009fad9200 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.180852:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007912 lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.180856:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007912 lrc: 4/0,0 mode: EX/EX res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.180862:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1010:0x0].0x0 (ffff880092bfc100) 00010000:00010000:2.0:1715205776.180864:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715205776.180865:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007912 lrc: 2/0,0 mode: --/EX res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.180869:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007912 lrc: 0/0,0 mode: --/EX res: [0x20001b1b3:0x1010:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00000080:1.0:1715205776.180961:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a18163c0 x1798520455776064/t330712482666(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.181016:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a18163c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+189:11754:x1798520455776064:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 338us (503us total) trans 330712482666 rc 0/0 00000100:00100000:1.0:1715205776.181023:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 526 00000100:00100000:3.0:1715205776.182157:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.182236:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455776192 00000100:00100000:2.0:1715205776.182264:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1923 00000100:00100000:2.0:1715205776.182267:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1812ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+189:11754:x1798520455776192:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.182279:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.182292:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af4305007920 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b238ef expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.182353:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af4305007927 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.182367:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af43050073ee lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236e9 expref: 190 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.182373:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af4305007927 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.182402:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af43050073ee lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236e9 expref: 190 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.182413:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af43050073ee lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236e9 expref: 190 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.182424:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034432:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.182481:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b316c0 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.183433:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034432:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.183455:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af4305007927 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.183593:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.183785:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455776256 00010000:00010000:0.0:1715205776.183805:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af43050073ee lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236e9 expref: 191 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.183972:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4755 00000100:00100000:0.0:1715205776.183978:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1815a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+191:1831:x1798520455776256:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205776.183993:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.183999:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af43050073ee lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236e9 expref: 191 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.184008:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af43050073ee lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236e9 expref: 191 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.184024:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af43050073ee lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236e9 expref: 191 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.184035:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1011:0x0].0x0 (ffff8800a6d13f00) 00010000:00010000:0.0:1715205776.184038:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af4305007927 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.184045:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af4305007927 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.184051:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af4305007927 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.184077:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.184133:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af4305007927 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.184142:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af4305007927 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.184154:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1011:0x0]: returning size 4096 00010000:00010000:2.0:1715205776.184259:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af4305007920 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238ef expref: 192 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.184270:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af4305007927 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238ef expref: 191 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.184275:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1011:0x0].0x0 (ffff8800a6d13f00) 00010000:00010000:2.0:1715205776.184277:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.184278:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fad9680, rc 0) 00010000:00000080:2.0:1715205776.184281:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1812ac0 x1798520455776192/t330712482667(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.184333:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1812ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+191:11754:x1798520455776192:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2064us (2177us total) trans 330712482667 rc 0/0 00000100:00100000:0.0:1715205776.184334:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1815a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+191:1831:x1798520455776256:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 355us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.184341:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4755 00000100:00100000:2.0:1715205776.184344:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1923 00000100:00100000:3.0:1715205776.185687:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.185756:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455776320 00000100:00100000:2.0:1715205776.185797:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1924 00000100:00100000:2.0:1715205776.185802:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1816d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+190:11754:x1798520455776320:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.185818:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.185830:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8480/0xb608af4305007935 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b238f6 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.185871:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af430500793c lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.185880:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af4305007927 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238ef expref: 191 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.185886:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af430500793c lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.185907:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af4305007927 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238ef expref: 191 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.185916:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af4305007927 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238ef expref: 191 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.185926:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034496:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.185966:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b316c0 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.187005:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034496:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.187010:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:2.0:1715205776.187022:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af430500793c lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.187058:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455776384 00010000:00010000:0.0:1715205776.187075:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af4305007927 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238ef expref: 192 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.187104:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4756 00000100:00100000:0.0:1715205776.187107:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1812f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+192:1830:x1798520455776384:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1715205776.187114:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.187117:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af4305007927 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238ef expref: 192 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.187124:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af4305007927 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238ef expref: 192 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.187136:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af4305007927 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238ef expref: 192 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.187146:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1011:0x0].0x0 (ffff8800a6d13f00) 00010000:00010000:0.0:1715205776.187149:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af430500793c lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.187154:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af430500793c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.187163:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af430500793c lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.187187:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.187215:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1812f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+191:1830:x1798520455776384:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 106us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.187221:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4756 00010000:00010000:2.0:1715205776.187270:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af430500793c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.187276:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af430500793c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.187302:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1011:0x0]: returning size 4096 00000004:00200000:2.0:1715205776.187305:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.187315:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af430500793c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.187323:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af430500793c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.187337:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8480/0xb608af4305007935 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238f6 expref: 191 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.187347:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af430500793c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238f6 expref: 190 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.187352:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1011:0x0].0x0 (ffff8800a6d13f00) 00010000:00010000:2.0:1715205776.187353:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.187355:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fad98c0, rc 0) 00010000:00000080:2.0:1715205776.187358:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1816d40 x1798520455776320/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.187381:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1816d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+190:11754:x1798520455776320:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1579us (1695us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.187386:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1924 00000100:00100000:3.0:1715205776.188398:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.188456:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455776512 00000100:00100000:1.0:1715205776.188487:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 527 00000100:00100000:1.0:1715205776.188491:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ded0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+190:11754:x1798520455776512:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.188601:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6ded0c0 x1798520455776512/t330712482668(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.188661:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ded0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+191:11754:x1798520455776512:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 169us (263us total) trans 330712482668 rc 0/0 00000100:00100000:1.0:1715205776.188667:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 527 00000100:00100000:3.0:1715205776.190222:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.190264:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455776640 00000100:00100000:2.0:1715205776.190302:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1925 00000100:00100000:2.0:1715205776.190307:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6deda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+191:11754:x1798520455776640:12345-192.168.204.8@tcp:36:dbench.0 00010000:00010000:2.0:1715205776.190334:0:14860:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1715205776.190348:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af430500793c lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238f6 expref: 191 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.190362:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc480/0xb608af4305007385 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236b8 expref: 190 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.190369:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1011:0x0].0x0 (ffff8800a6d13f00) 00010000:00010000:2.0:1715205776.190378:0:14860:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.190395:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af4305007943 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.190404:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af4305007943 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.190411:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af4305007943 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.190421:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af430500794a lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.190425:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af430500794a lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.190430:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af430500794a lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.190522:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007951 lrc: 3/0,1 mode: --/EX res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.190527:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007951 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.190533:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007951 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1715205776.190886:0:14860:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x134:0x0].74, 64 off12928 00010000:00010000:2.0:1715205776.190927:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007958 lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.190933:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007958 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.190939:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007958 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.190944:0:14860:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007958 lrc: 4/0,1 mode: PW/PW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.190948:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007958 lrc: 4/0,1 mode: PW/PW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.190953:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007958 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.190971:0:14860:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1715205776.190984:0:14860:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff8800a6deda40 reply state ffff880135e11000 transno 330712482669 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007951 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.190995:0:6665:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715205776.190999:0:6665:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007958 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.191007:0:6665:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009fad8fc0 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:3.0:1715205776.191009:0:6665:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007958 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.191016:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af4305007943 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.191016:0:6665:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007958 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.191021:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af4305007943 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.191024:0:6665:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1011:0x0].0x0 (ffff880092bfc000) 00010000:00010000:2.0:1715205776.191025:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af4305007943 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.191025:0:6665:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1715205776.191027:0:6665:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007958 lrc: 1/0,0 mode: --/PW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.191029:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009fad8900 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.191031:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af4305007943 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.191031:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007958 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.191036:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af4305007943 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.191041:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.191044:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.191045:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af4305007943 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.191049:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af4305007943 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.191054:0:6665:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1715205776.191055:0:14860:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff8800a6deda40 reply state ffff880135e11000 transno 330712482669 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af430500794a lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.191055:0:6665:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715205776.191056:0:6665:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000080:2.0:1715205776.191067:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6deda40 x1798520455776640/t330712482669(0) o36->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 496/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.191103:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6deda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+191:11754:x1798520455776640:12345-192.168.204.8@tcp:36:dbench.0 Request processed in 796us (884us total) trans 330712482669 rc 0/0 00000100:00100000:2.0:1715205776.191108:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1925 00000100:00100000:3.0:1715205776.192203:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:0.0:1715205776.192237:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af430500794a lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.192244:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af430500794a lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.192249:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af430500794a lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.192253:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009fad86c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.192255:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af430500794a lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.192260:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af430500794a lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.192265:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455776704 00010000:00010000:0.0:1715205776.192267:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x5a9c1470 (ffff880092bfc100) 00010000:00010000:0.0:1715205776.192268:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.192269:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af430500794a lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.192273:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af430500794a lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.192284:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007951 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.192288:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007951 lrc: 2/0,0 mode: EX/EX res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.192292:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007951 lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.192295:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009fadb840 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.192296:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007951 lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.192298:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1926 00010000:00010000:0.0:1715205776.192300:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007951 lrc: 4/0,0 mode: EX/EX res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.192303:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6de97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+191:11754:x1798520455776704:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.192304:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1011:0x0].0x0 (ffff880092bfc000) 00010000:00010000:0.0:1715205776.192305:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715205776.192306:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007951 lrc: 2/0,0 mode: --/EX res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.192310:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007951 lrc: 0/0,0 mode: --/EX res: [0x20001b1b3:0x1011:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.192313:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.192320:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af430500795f lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b238fd expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.192349:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007966 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.192356:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007966 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.192362:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007966 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.192371:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500796d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.192376:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500796d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.192382:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500796d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.192427:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007966 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.192432:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007966 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.192437:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007966 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.192441:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009fad8b40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.192443:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007966 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.192447:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007966 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.192453:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.192455:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.192456:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007966 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.192460:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007966 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.192467:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500796d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.192470:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500796d lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.192478:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500796d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.192482:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009fada1c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.192484:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500796d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.192487:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500796d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.192492:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x4f529a91 (ffff880092bfc900) 00010000:00010000:2.0:1715205776.192494:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.192495:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500796d lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.192499:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500796d lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.192524:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af430500795f lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238fd expref: 191 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.192529:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af430500795f lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238fd expref: 191 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.192535:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fad9200, rc 0) 00010000:00000080:2.0:1715205776.192539:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6de97c0 x1798520455776704/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.192579:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6de97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+190:11754:x1798520455776704:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 265us (367us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205776.192584:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1926 00000100:00100000:3.0:1715205776.193866:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.193907:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455776768 00000100:00100000:2.0:1715205776.193939:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1927 00000100:00100000:2.0:1715205776.193943:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6de9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+190:11754:x1798520455776768:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.193951:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.193958:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007974 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23904 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.193972:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007974 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23904 expref: 191 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.193979:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007974 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23904 expref: 191 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.193983:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.193985:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.193986:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fad8240, rc 0) 00010000:00000080:2.0:1715205776.193989:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6de9c80 x1798520455776768/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 328/344 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.194023:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6de9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+191:11754:x1798520455776768:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 79us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.194028:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1927 00000100:00100000:3.0:1715205776.195567:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.195718:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455776832 00000100:00100000:2.0:1715205776.195764:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 528 00000100:00100000:2.0:1715205776.195768:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6def200 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+191:11754:x1798520455776832:12345-192.168.204.8@tcp:37:dbench.0 00010000:00000080:2.0:1715205776.197440:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6def200 x1798520455776832/t0(0) o37->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 448/440 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.197487:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6def200 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+191:11754:x1798520455776832:12345-192.168.204.8@tcp:37:dbench.0 Request processed in 1718us (1926us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.197495:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 528 00000100:00100000:2.0:1715205776.198881:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.198944:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455776960 00000100:00100000:0.0:1715205776.198993:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1928 00000100:00100000:0.0:1715205776.198997:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c220980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+191:11754:x1798520455776960:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.199008:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.199019:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af430500797b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2390b expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.199074:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305007982 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.199082:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500782b lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23894 expref: 192 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.199086:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305007982 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.199106:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500782b lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23894 expref: 192 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.199112:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500782b lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23894 expref: 192 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.199120:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034560:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.199308:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800943a1480 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.201282:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034560:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.201310:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305007982 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.202083:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.202137:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455777024 00010000:00010000:0.0:1715205776.202158:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500782b lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23894 expref: 193 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.202183:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4757 00000100:00100000:0.0:1715205776.202187:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c220000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+193:1831:x1798520455777024:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1715205776.202194:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.202196:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500782b lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23894 expref: 193 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.202203:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500782b lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23894 expref: 193 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.202218:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af430500782b lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23894 expref: 193 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.202243:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:0.0:1715205776.202247:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305007982 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.202253:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305007982 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.202259:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305007982 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.202290:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.202325:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c220000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+192:1831:x1798520455777024:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 138us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.202331:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4757 00010000:00010000:1.0:1715205776.202365:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305007982 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.202376:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305007982 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205776.202389:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeec:0x0]: returning size 260096 00010000:00010000:1.0:1715205776.202664:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af430500797b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2390b expref: 193 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.202713:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305007982 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2390b expref: 192 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.202719:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:1.0:1715205776.202721:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205776.202723:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59f3c0, rc 0) 00010000:00000080:1.0:1715205776.202726:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c220980 x1798520455776960/t330712482670(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.202769:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c220980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+192:11754:x1798520455776960:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 3771us (3891us total) trans 330712482670 rc 0/0 00000100:00100000:1.0:1715205776.202778:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1928 00000100:00100000:2.0:1715205776.204024:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.204101:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455777088 00000100:00100000:1.0:1715205776.204126:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1929 00000100:00100000:1.0:1715205776.204130:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c225a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+192:11754:x1798520455777088:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.204146:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.204156:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007990 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23912 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.204202:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007997 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.204210:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305007982 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2390b expref: 193 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.204216:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007997 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.204237:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305007982 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2390b expref: 193 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.204250:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305007982 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2390b expref: 193 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.204260:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034624:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.204489:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b48b29c0 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.206116:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034624:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.206131:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007997 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.207043:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.207093:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455777152 00010000:00010000:0.0:1715205776.207116:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305007982 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2390b expref: 194 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.207150:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4758 00000100:00100000:0.0:1715205776.207154:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5241850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+194:1829:x1798520455777152:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1715205776.207164:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.207168:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305007982 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2390b expref: 194 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.207176:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305007982 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2390b expref: 194 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.207188:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305007982 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2390b expref: 194 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.207211:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:0.0:1715205776.207215:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007997 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.207220:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007997 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.207225:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007997 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.207247:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.207286:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5241850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+193:1829:x1798520455777152:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 130us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.207292:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4758 00010000:00010000:1.0:1715205776.207306:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007997 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.207312:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007997 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205776.207340:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeec:0x0]: returning size 260096 00000004:00200000:1.0:1715205776.207343:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205776.207355:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007997 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.207362:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007997 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.207379:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007990 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23912 expref: 193 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.207388:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007997 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23912 expref: 192 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.207394:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:1.0:1715205776.207396:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205776.207397:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9aac0, rc 0) 00010000:00000080:1.0:1715205776.207402:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c225a40 x1798520455777088/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.207440:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c225a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+192:11754:x1798520455777088:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 3308us (3417us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.207445:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1929 00000100:00100000:2.0:1715205776.208698:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.208785:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455777216 00000100:00100000:1.0:1715205776.208814:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1930 00000100:00100000:1.0:1715205776.208817:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2204c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+192:11754:x1798520455777216:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.208832:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.208849:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af430500799e lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23919 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.208889:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af43050079a5 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.208898:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af43050079a5 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.208905:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af43050079a5 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.208912:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079ac lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.208918:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079ac lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.208921:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079ac lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.208980:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af43050079a5 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.208982:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af43050079a5 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.208985:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af43050079a5 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.208989:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd9a640 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.208991:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af43050079a5 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.208994:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af43050079a5 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.208999:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205776.209001:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.209003:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af43050079a5 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.209005:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af43050079a5 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.209014:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079ac lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.209017:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079ac lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.209020:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079ac lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.209022:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd9b3c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.209022:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079ac lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.209025:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079ac lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.209027:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x4f529a91 (ffff880129f26b00) 00010000:00010000:1.0:1715205776.209028:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.209029:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079ac lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.209031:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079ac lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.209050:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af430500799e lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23919 expref: 193 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.209053:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af430500799e lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23919 expref: 193 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.209058:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9bcc0, rc 0) 00010000:00000080:1.0:1715205776.209061:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c2204c0 x1798520455777216/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.209106:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2204c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+192:11754:x1798520455777216:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 287us (413us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205776.209112:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1930 00000100:00100000:2.0:1715205776.210641:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.210719:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455777344 00000100:00100000:0.0:1715205776.210774:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 529 00000100:00100000:0.0:1715205776.210779:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c224280 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+192:11754:x1798520455777344:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205776.210918:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c224280 x1798520455777344/t330712482671(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.210964:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c224280 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+193:11754:x1798520455777344:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 185us (348us total) trans 330712482671 rc 0/0 00000100:00100000:0.0:1715205776.210971:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 529 00000100:00100000:3.0:1715205776.213095:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.213171:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455777472 00000100:00100000:1.0:1715205776.213378:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1931 00000100:00100000:1.0:1715205776.213384:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ded580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+193:11754:x1798520455777472:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.213402:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.213418:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af43050079b3 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23920 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.213500:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050079ba lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.213512:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007997 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23912 expref: 194 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.213518:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050079ba lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.213611:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007997 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23912 expref: 194 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.213755:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007997 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23912 expref: 194 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.214708:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034688:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.214802:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b48b29c0 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.216051:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034688:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.216074:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050079ba lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.216238:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.216912:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455777536 00010000:00010000:0.0:1715205776.216935:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007997 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23912 expref: 195 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.216960:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4759 00000100:00100000:0.0:1715205776.216965:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6deed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+195:1831:x1798520455777536:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205776.216976:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.216979:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007997 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23912 expref: 195 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.216987:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007997 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23912 expref: 195 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.217002:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af4305007997 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23912 expref: 195 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.217017:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:0.0:1715205776.217020:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050079ba lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.217031:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050079ba lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.217036:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050079ba lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.217053:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205776.217077:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050079ba lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.217083:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6deed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+194:1831:x1798520455777536:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 118us (846us total) trans 0 rc 0/0 00010000:00010000:1.0:1715205776.217085:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050079ba lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.217088:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4759 00000004:00200000:1.0:1715205776.217101:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeec:0x0]: returning size 260096 00010000:00010000:1.0:1715205776.217216:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af43050079b3 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23920 expref: 195 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.217226:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050079ba lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23920 expref: 194 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.217231:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:1.0:1715205776.217233:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205776.217234:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9b600, rc 0) 00010000:00000080:1.0:1715205776.217239:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6ded580 x1798520455777472/t330712482672(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.217283:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ded580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+194:11754:x1798520455777472:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 3898us (4191us total) trans 330712482672 rc 0/0 00000100:00100000:1.0:1715205776.217292:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1931 00000100:00100000:3.0:1715205776.218660:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.218754:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455777600 00000100:00100000:1.0:1715205776.218789:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1932 00000100:00100000:1.0:1715205776.218792:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6dee880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+194:11754:x1798520455777600:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.218807:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.218817:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af43050079c8 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23927 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.218857:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af43050079cf lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.218866:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050079ba lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23920 expref: 195 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.218869:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af43050079cf lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.218889:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050079ba lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23920 expref: 195 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.218897:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050079ba lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23920 expref: 195 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.218904:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034752:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.218954:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b48b29c0 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.220274:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.220283:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034752:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.220306:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af43050079cf lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.220338:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455777664 00010000:00010000:0.0:1715205776.220352:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050079ba lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23920 expref: 196 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.220374:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4760 00000100:00100000:0.0:1715205776.220376:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c224c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+196:1830:x1798520455777664:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1715205776.220383:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.220386:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050079ba lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23920 expref: 196 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.220391:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050079ba lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23920 expref: 196 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.220402:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050079ba lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23920 expref: 196 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.220411:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:0.0:1715205776.220414:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af43050079cf lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.220418:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af43050079cf lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.220421:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af43050079cf lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.220436:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.220462:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c224c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+195:1830:x1798520455777664:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 85us (193us total) trans 0 rc 0/0 00010000:00010000:1.0:1715205776.220463:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af43050079cf lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.220466:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4760 00010000:00010000:1.0:1715205776.220473:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af43050079cf lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205776.220503:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeec:0x0]: returning size 260096 00000004:00200000:1.0:1715205776.220506:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205776.220519:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af43050079cf lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.220529:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af43050079cf lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.220548:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af43050079c8 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23927 expref: 195 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.220559:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af43050079cf lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23927 expref: 194 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.220565:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:1.0:1715205776.220567:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205776.220568:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd98fc0, rc 0) 00010000:00000080:1.0:1715205776.220572:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6dee880 x1798520455777600/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.220611:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6dee880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+194:11754:x1798520455777600:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1817us (1955us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.220636:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1932 00000100:00100000:2.0:1715205776.222945:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.222987:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455777792 00000100:00100000:1.0:1715205776.223017:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1933 00000100:00100000:1.0:1715205776.223021:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c224740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+194:11754:x1798520455777792:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.223034:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.223045:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af43050079d6 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2392e expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.223104:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079dd lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.223116:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af430500784e lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238a2 expref: 195 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.223122:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079dd lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.223146:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af430500784e lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238a2 expref: 195 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.223155:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af430500784e lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238a2 expref: 195 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.223164:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034816:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.223205:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b48b29c0 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.224090:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034816:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.224103:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079dd lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.224497:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.224550:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455777856 00010000:00010000:0.0:1715205776.224564:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af430500784e lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238a2 expref: 196 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.224579:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4761 00000100:00100000:0.0:1715205776.224582:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c220000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+196:1831:x1798520455777856:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1715205776.224589:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.224592:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af430500784e lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238a2 expref: 196 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.224598:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af430500784e lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238a2 expref: 196 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.224609:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af430500784e lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238a2 expref: 196 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.224640:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeed:0x0].0x0 (ffff880092452f00) 00010000:00010000:0.0:1715205776.224643:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079dd lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.224649:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079dd lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.224653:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079dd lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.224759:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.224787:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c220000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+195:1831:x1798520455777856:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 203us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.224792:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4761 00010000:00010000:1.0:1715205776.224827:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079dd lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.224832:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079dd lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205776.224842:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeed:0x0]: returning size 260096 00010000:00010000:1.0:1715205776.224924:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af43050079d6 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2392e expref: 196 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.224933:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079dd lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2392e expref: 195 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.224938:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeed:0x0].0x0 (ffff880092452f00) 00010000:00010000:1.0:1715205776.224940:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205776.224941:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9b3c0, rc 0) 00010000:00000080:1.0:1715205776.224944:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c224740 x1798520455777792/t330712482673(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.225049:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c224740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+195:11754:x1798520455777792:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2027us (2106us total) trans 330712482673 rc 0/0 00000100:00100000:1.0:1715205776.225054:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1933 00000100:00100000:2.0:1715205776.226559:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.226661:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455777920 00000100:00100000:1.0:1715205776.226693:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1934 00000100:00100000:1.0:1715205776.226697:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c222ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+195:11754:x1798520455777920:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.226719:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.226733:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af43050079eb lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23935 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.226818:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050079f2 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.226831:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079dd lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2392e expref: 196 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.226837:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050079f2 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.226861:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079dd lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2392e expref: 196 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.226871:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079dd lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2392e expref: 196 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.226881:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034880:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.226939:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b48b29c0 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.228055:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.228102:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455777984 00010000:00010000:0.0:1715205776.228121:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079dd lrc: 5/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2392e expref: 197 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.228137:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034880:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.228144:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4762 00000100:00100000:0.0:1715205776.228148:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c222f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+197:1828:x1798520455777984:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1715205776.228155:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050079f2 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.228156:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.228160:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079dd lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2392e expref: 197 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.228167:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079dd lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2392e expref: 197 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.228182:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af43050079dd lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2392e expref: 197 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.228189:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeed:0x0].0x0 (ffff880092452f00) 00010000:00010000:0.0:1715205776.228192:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050079f2 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.228196:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050079f2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.228199:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050079f2 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.228215:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.228236:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c222f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+196:1828:x1798520455777984:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 89us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.228240:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4762 00010000:00010000:1.0:1715205776.228240:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050079f2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.228247:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050079f2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205776.228279:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeed:0x0]: returning size 260096 00000004:00200000:1.0:1715205776.228284:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205776.228297:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050079f2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.228306:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050079f2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.228322:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af43050079eb lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23935 expref: 196 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.228334:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050079f2 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23935 expref: 195 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.228341:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeed:0x0].0x0 (ffff880092452f00) 00010000:00010000:1.0:1715205776.228343:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205776.228344:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9aac0, rc 0) 00010000:00000080:1.0:1715205776.228348:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c222ac0 x1798520455777920/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.228395:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c222ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+195:11754:x1798520455777920:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1697us (1841us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.228402:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1934 00000100:00100000:2.0:1715205776.230021:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.230064:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455778112 00000100:00100000:1.0:1715205776.230097:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1935 00000100:00100000:1.0:1715205776.230102:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c223440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+195:11754:x1798520455778112:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.230119:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.230128:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af43050079f9 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2393c expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.230190:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007a00 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.230198:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007871 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238b0 expref: 196 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.230202:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007a00 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.230218:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007871 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238b0 expref: 196 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.230224:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007871 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238b0 expref: 196 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.230230:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034944:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.230269:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b48b29c0 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.231061:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456034944:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.231075:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007a00 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.231222:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.231327:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455778176 00010000:00010000:0.0:1715205776.231341:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007871 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238b0 expref: 197 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.231359:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4763 00000100:00100000:0.0:1715205776.231362:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2276c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+197:1830:x1798520455778176:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205776.231370:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.231372:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007871 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238b0 expref: 197 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.231383:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007871 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238b0 expref: 197 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.231398:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007871 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238b0 expref: 197 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.231405:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeee:0x0].0x0 (ffff8800b410f900) 00010000:00010000:0.0:1715205776.231407:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007a00 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.231412:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007a00 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.231416:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007a00 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.231432:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205776.231452:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007a00 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.231458:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2276c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+196:1830:x1798520455778176:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 95us (237us total) trans 0 rc 0/0 00010000:00010000:1.0:1715205776.231458:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007a00 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.231463:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4763 00000004:00200000:1.0:1715205776.231467:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeee:0x0]: returning size 260096 00010000:00010000:1.0:1715205776.231679:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af43050079f9 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2393c expref: 197 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.231693:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007a00 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2393c expref: 196 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.231698:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeee:0x0].0x0 (ffff8800b410f900) 00010000:00010000:1.0:1715205776.231700:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205776.231701:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd99200, rc 0) 00010000:00000080:1.0:1715205776.231705:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c223440 x1798520455778112/t330712482674(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.231976:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c223440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+196:11754:x1798520455778112:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1872us (1956us total) trans 330712482674 rc 0/0 00000100:00100000:1.0:1715205776.231982:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1935 00000100:00100000:2.0:1715205776.233570:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.233612:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455778240 00000100:00100000:1.0:1715205776.233653:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1936 00000100:00100000:1.0:1715205776.233656:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c221300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+196:11754:x1798520455778240:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.233666:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.233673:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007a0e lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23943 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.233701:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007a15 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.233708:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007a00 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2393c expref: 197 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.233713:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007a15 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.233731:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007a00 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2393c expref: 197 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.233751:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007a00 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2393c expref: 197 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.233759:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035008:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.233795:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b48b29c0 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.234531:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035008:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.234541:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007a15 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.234863:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.235050:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455778304 00010000:00010000:0.0:1715205776.235063:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007a00 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2393c expref: 198 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.235082:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4764 00000100:00100000:0.0:1715205776.235086:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce79300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+198:1830:x1798520455778304:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1715205776.235091:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.235094:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007a00 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2393c expref: 198 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.235100:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007a00 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2393c expref: 198 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.235109:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007a00 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2393c expref: 198 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.235116:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeee:0x0].0x0 (ffff8800b410f900) 00010000:00010000:0.0:1715205776.235118:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007a15 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.235123:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007a15 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.235127:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007a15 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.235146:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205776.235163:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007a15 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.235168:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce79300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+197:1830:x1798520455778304:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 82us (307us total) trans 0 rc 0/0 00010000:00010000:1.0:1715205776.235169:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007a15 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.235173:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4764 00000004:00200000:1.0:1715205776.235188:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeee:0x0]: returning size 260096 00000004:00200000:1.0:1715205776.235190:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205776.235198:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007a15 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.235205:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007a15 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.235216:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007a0e lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23943 expref: 197 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.235229:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007a15 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23943 expref: 196 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.235234:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeee:0x0].0x0 (ffff8800b410f900) 00010000:00010000:1.0:1715205776.235236:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205776.235237:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd99680, rc 0) 00010000:00000080:1.0:1715205776.235240:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c221300 x1798520455778240/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.235279:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c221300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+196:11754:x1798520455778240:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1622us (1712us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.235286:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1936 00000100:00100000:2.0:1715205776.236777:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.236853:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455778432 00000100:00100000:1.0:1715205776.236933:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1937 00000100:00100000:1.0:1715205776.236938:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+196:11754:x1798520455778432:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.236947:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.236956:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af4305007a1c lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2394a expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.237004:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007a23 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.237014:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007894 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238be expref: 197 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.237019:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007a23 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.237039:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007894 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238be expref: 197 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.237046:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007894 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238be expref: 197 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.237053:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035072:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.237091:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b48b29c0 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.238148:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035072:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.238163:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007a23 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.238248:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.238411:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455778496 00010000:00010000:0.0:1715205776.238426:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007894 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238be expref: 198 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.238454:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4765 00000100:00100000:0.0:1715205776.238457:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+198:1831:x1798520455778496:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1715205776.238466:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.238469:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007894 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238be expref: 198 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.238476:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007894 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238be expref: 198 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.238487:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007894 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238be expref: 198 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.238496:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeef:0x0].0x0 (ffff880129f26800) 00010000:00010000:0.0:1715205776.238498:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007a23 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.238503:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007a23 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.238507:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007a23 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.238525:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.238550:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+197:1831:x1798520455778496:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 92us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.238554:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4765 00010000:00010000:1.0:1715205776.238592:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007a23 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.238599:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007a23 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205776.238610:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeef:0x0]: returning size 260096 00010000:00010000:1.0:1715205776.238722:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af4305007a1c lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2394a expref: 198 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.238732:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007a23 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2394a expref: 197 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.238749:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeef:0x0].0x0 (ffff880129f26800) 00010000:00010000:1.0:1715205776.238751:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205776.238753:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9a880, rc 0) 00010000:00000080:1.0:1715205776.238756:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce7bdc0 x1798520455778432/t330712482675(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.238787:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+197:11754:x1798520455778432:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1848us (2013us total) trans 330712482675 rc 0/0 00000100:00100000:1.0:1715205776.238792:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1937 00000100:00100000:2.0:1715205776.240602:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.241371:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455778560 00000100:00100000:0.0:1715205776.241406:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1938 00000100:00100000:0.0:1715205776.241411:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+197:11754:x1798520455778560:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.241433:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.241443:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305007a31 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23951 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.241495:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305007a38 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.241505:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007a23 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2394a expref: 198 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.241511:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305007a38 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.241531:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007a23 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2394a expref: 198 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.241540:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007a23 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2394a expref: 198 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.241548:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035136:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.241591:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b50f780 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.242971:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035136:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.242983:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305007a38 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.243163:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.243214:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455778624 00010000:00010000:3.0:1715205776.243228:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007a23 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2394a expref: 199 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.243253:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4766 00000100:00100000:3.0:1715205776.243257:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7b900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+199:1830:x1798520455778624:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205776.243265:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.243268:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007a23 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2394a expref: 199 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.243275:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007a23 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2394a expref: 199 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.243285:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007a23 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2394a expref: 199 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.243293:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeef:0x0].0x0 (ffff880129f26800) 00010000:00010000:3.0:1715205776.243295:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305007a38 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.243301:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305007a38 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.243305:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305007a38 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.243316:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205776.243342:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7b900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+198:1830:x1798520455778624:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 84us (179us total) trans 0 rc 0/0 00010000:00010000:0.0:1715205776.243343:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305007a38 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.243348:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4766 00010000:00010000:0.0:1715205776.243349:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305007a38 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.243378:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeef:0x0]: returning size 260096 00000004:00200000:0.0:1715205776.243382:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205776.243391:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305007a38 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.243398:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305007a38 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.243410:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305007a31 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23951 expref: 198 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.243416:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305007a38 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23951 expref: 197 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.243419:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeef:0x0].0x0 (ffff880129f26800) 00010000:00010000:0.0:1715205776.243420:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205776.243421:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59d680, rc 0) 00010000:00000080:0.0:1715205776.243424:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce7df00 x1798520455778560/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.243449:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+197:11754:x1798520455778560:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2038us (2849us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.243454:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1938 00000100:00100000:2.0:1715205776.245011:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.245064:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455778752 00000100:00100000:0.0:1715205776.245082:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1939 00000100:00100000:0.0:1715205776.245085:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+197:11754:x1798520455778752:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.245095:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.245103:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305007a3f lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23958 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.245148:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007a46 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.245157:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af43050078b7 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238cc expref: 198 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.245162:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007a46 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.245178:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af43050078b7 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238cc expref: 198 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.245185:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af43050078b7 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238cc expref: 198 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.245193:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035200:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.245335:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b50f780 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.246081:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035200:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.246092:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007a46 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.246418:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.246469:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455778816 00010000:00010000:3.0:1715205776.246480:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af43050078b7 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238cc expref: 199 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.246567:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4767 00000100:00100000:3.0:1715205776.246570:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+199:1831:x1798520455778816:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1715205776.246576:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.246579:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af43050078b7 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238cc expref: 199 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.246586:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af43050078b7 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238cc expref: 199 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.246596:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af43050078b7 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238cc expref: 199 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.246605:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef0:0x0].0x0 (ffff88009c8aab00) 00010000:00010000:3.0:1715205776.246607:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007a46 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.246612:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007a46 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.246762:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007a46 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.246783:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205776.246802:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+198:1831:x1798520455778816:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 231us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.246808:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4767 00010000:00010000:0.0:1715205776.246886:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007a46 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.246892:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007a46 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.246905:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xef0:0x0]: returning size 260096 00010000:00010000:0.0:1715205776.246988:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305007a3f lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23958 expref: 199 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.246997:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007a46 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23958 expref: 198 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.247002:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef0:0x0].0x0 (ffff88009c8aab00) 00010000:00010000:0.0:1715205776.247003:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205776.247004:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59c000, rc 0) 00010000:00000080:0.0:1715205776.247007:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce7a600 x1798520455778752/t330712482676(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.247027:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+198:11754:x1798520455778752:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1941us (2018us total) trans 330712482676 rc 0/0 00000100:00100000:0.0:1715205776.247032:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1939 00000100:00100000:2.0:1715205776.248493:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.248760:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455778880 00000100:00100000:0.0:1715205776.248780:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1940 00000100:00100000:0.0:1715205776.248784:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce78e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+198:11754:x1798520455778880:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.248794:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.248815:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007a54 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2395f expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.248912:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af4305007a5b lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.248921:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007a46 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23958 expref: 199 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.248927:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af4305007a5b lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.248941:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007a46 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23958 expref: 199 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.248948:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007a46 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23958 expref: 199 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.248956:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035264:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.248993:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b50f780 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.250145:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035264:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.250155:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af4305007a5b lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.250244:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.250282:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455778944 00010000:00010000:3.0:1715205776.250294:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007a46 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23958 expref: 200 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.250321:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4768 00000100:00100000:3.0:1715205776.250325:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce78980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+200:1831:x1798520455778944:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1715205776.250331:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.250334:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007a46 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23958 expref: 200 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.250341:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007a46 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23958 expref: 200 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.250350:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007a46 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23958 expref: 200 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.250359:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef0:0x0].0x0 (ffff88009c8aab00) 00010000:00010000:3.0:1715205776.250361:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af4305007a5b lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.250366:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af4305007a5b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.250371:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af4305007a5b lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.250386:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.250392:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af4305007a5b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.250398:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af4305007a5b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.250410:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce78980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+199:1831:x1798520455778944:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 85us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.250415:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4768 00000004:00200000:0.0:1715205776.250416:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xef0:0x0]: returning size 260096 00000004:00200000:0.0:1715205776.250419:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205776.250427:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af4305007a5b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.250433:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af4305007a5b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.250454:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007a54 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2395f expref: 199 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.250462:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af4305007a5b lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2395f expref: 198 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.250467:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef0:0x0].0x0 (ffff88009c8aab00) 00010000:00010000:0.0:1715205776.250469:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205776.250470:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59f600, rc 0) 00010000:00000080:0.0:1715205776.250473:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce78e40 x1798520455778880/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.250496:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce78e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+198:11754:x1798520455778880:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1711us (2004us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.250501:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1940 00000100:00100000:3.0:1715205776.251903:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.251920:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455779072 00000100:00100000:0.0:1715205776.251947:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1941 00000100:00100000:0.0:1715205776.251951:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6dea140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+198:11754:x1798520455779072:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.251958:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.251964:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305007a62 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23966 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.252006:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007a69 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.252015:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007736 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23832 expref: 199 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.252024:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007a69 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.252037:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007736 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23832 expref: 199 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.252044:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007736 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23832 expref: 199 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.252052:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035328:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.252073:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b50f780 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.254006:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035328:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.254015:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:0.0:1715205776.254016:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007a69 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.254031:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455779136 00010000:00010000:3.0:1715205776.254042:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007736 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23832 expref: 200 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.254053:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4769 00000100:00100000:3.0:1715205776.254055:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+200:1830:x1798520455779136:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1715205776.254059:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.254061:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007736 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23832 expref: 200 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.254066:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007736 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23832 expref: 200 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.254073:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172f40/0xb608af4305007736 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23832 expref: 200 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.254078:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:3.0:1715205776.254080:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007a69 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.254083:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007a69 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.254089:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007a69 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.254097:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.254102:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007a69 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.254107:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007a69 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.254116:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee4:0x0]: returning size 260096 00000100:00100000:3.0:1715205776.254117:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+199:1830:x1798520455779136:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 61us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.254120:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4769 00010000:00010000:0.0:1715205776.254192:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305007a62 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23966 expref: 200 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.254200:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007a69 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23966 expref: 199 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.254209:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:0.0:1715205776.254211:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205776.254212:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59db00, rc 0) 00010000:00000080:0.0:1715205776.254215:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6dea140 x1798520455779072/t330712482677(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.254244:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6dea140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+199:11754:x1798520455779072:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2292us (2342us total) trans 330712482677 rc 0/0 00000100:00100000:0.0:1715205776.254249:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1941 00000100:00100000:2.0:1715205776.254973:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.255000:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455779200 00000100:00100000:0.0:1715205776.255016:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1942 00000100:00100000:0.0:1715205776.255019:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+199:11754:x1798520455779200:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.255028:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.255034:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af4305007a77 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2396d expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.255058:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305007a7e lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.255066:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007a69 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23966 expref: 200 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.255070:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305007a7e lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.255082:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007a69 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23966 expref: 200 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.255090:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007a69 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23966 expref: 200 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.255095:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035392:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.255119:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b50f780 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.256059:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.256068:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035392:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.256089:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305007a7e lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.256104:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455779264 00010000:00010000:3.0:1715205776.256114:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007a69 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23966 expref: 201 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.256128:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4770 00000100:00100000:3.0:1715205776.256131:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+201:1829:x1798520455779264:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205776.256137:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.256140:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007a69 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23966 expref: 201 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.256146:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007a69 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23966 expref: 201 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.256154:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007a69 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23966 expref: 201 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.256160:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:3.0:1715205776.256163:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305007a7e lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.256171:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305007a7e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.256175:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305007a7e lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.256193:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205776.256216:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+200:1829:x1798520455779264:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 84us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.256222:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4770 00010000:00010000:0.0:1715205776.256230:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305007a7e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.256236:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305007a7e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.256249:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee4:0x0]: returning size 260096 00000004:00200000:0.0:1715205776.256251:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205776.256257:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305007a7e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.256262:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305007a7e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.256270:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af4305007a77 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2396d expref: 200 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.256276:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305007a7e lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2396d expref: 199 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.256279:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:0.0:1715205776.256280:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205776.256281:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59eac0, rc 0) 00010000:00000080:0.0:1715205776.256283:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce7c740 x1798520455779200/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.256300:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+199:11754:x1798520455779200:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1280us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.256303:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1942 00000100:00100000:2.0:1715205776.257449:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.257506:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455779392 00000100:00100000:1.0:1715205776.257528:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1943 00000100:00100000:1.0:1715205776.257531:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+199:11754:x1798520455779392:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.257538:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.257544:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007a85 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23974 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.257580:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007a8c lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.257588:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305007759 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23840 expref: 200 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.257592:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007a8c lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.257606:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305007759 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23840 expref: 200 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.257612:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305007759 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23840 expref: 200 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.257636:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035456:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.257667:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b9d19c0 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.258339:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035456:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.258349:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007a8c lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.258529:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.258608:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455779456 00010000:00010000:0.0:1715205776.258633:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305007759 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23840 expref: 201 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.258654:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4771 00000100:00100000:0.0:1715205776.258658:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+201:1831:x1798520455779456:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205776.258663:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.258666:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305007759 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23840 expref: 201 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.258672:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305007759 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23840 expref: 201 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.258681:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099173600/0xb608af4305007759 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23840 expref: 201 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.258688:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee5:0x0].0x0 (ffff8800a5d65a00) 00010000:00010000:0.0:1715205776.258690:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007a8c lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.258695:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007a8c lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.258699:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007a8c lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.258717:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205776.258734:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007a8c lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.258749:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+200:1831:x1798520455779456:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 90us (220us total) trans 0 rc 0/0 00010000:00010000:1.0:1715205776.258751:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007a8c lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.258754:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4771 00000004:00200000:1.0:1715205776.258760:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee5:0x0]: returning size 260096 00010000:00010000:1.0:1715205776.258829:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007a85 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23974 expref: 201 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.258835:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007a8c lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23974 expref: 200 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.258838:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee5:0x0].0x0 (ffff8800a5d65a00) 00010000:00010000:1.0:1715205776.258843:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205776.258844:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd998c0, rc 0) 00010000:00000080:1.0:1715205776.258846:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce7f200 x1798520455779392/t330712482678(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.258863:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+200:11754:x1798520455779392:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1332us (1416us total) trans 330712482678 rc 0/0 00000100:00100000:1.0:1715205776.258867:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1943 00000100:00100000:2.0:1715205776.259552:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.259564:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455779520 00000100:00100000:1.0:1715205776.259578:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1944 00000100:00100000:1.0:1715205776.259582:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+200:11754:x1798520455779520:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.259590:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.259594:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af4305007a9a lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2397b expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.259613:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af4305007aa1 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.259637:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007a8c lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23974 expref: 201 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.259642:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af4305007aa1 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.259654:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007a8c lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23974 expref: 201 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.259661:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007a8c lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23974 expref: 201 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.259667:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035520:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.259696:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b9d19c0 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.260272:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035520:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.260279:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af4305007aa1 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.260368:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.260397:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455779584 00010000:00010000:1.0:1715205776.260407:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007a8c lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23974 expref: 202 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.260422:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4772 00000100:00100000:1.0:1715205776.260426:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+202:1830:x1798520455779584:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1715205776.260431:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.260433:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007a8c lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23974 expref: 202 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.260439:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007a8c lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23974 expref: 202 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.260446:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007a8c lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23974 expref: 202 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.260451:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee5:0x0].0x0 (ffff8800a5d65a00) 00010000:00010000:1.0:1715205776.260452:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af4305007aa1 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.260455:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af4305007aa1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.260458:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af4305007aa1 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.260465:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.260470:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af4305007aa1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.260475:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af4305007aa1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.260486:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+201:1830:x1798520455779584:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 61us (120us total) trans 0 rc 0/0 00000004:00200000:2.0:1715205776.260487:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee5:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.260489:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:1.0:1715205776.260490:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4772 00000004:00010000:2.0:1715205776.260497:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af4305007aa1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.260503:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af4305007aa1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.260515:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af4305007a9a lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2397b expref: 201 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.260523:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af4305007aa1 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2397b expref: 200 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.260528:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee5:0x0].0x0 (ffff8800a5d65a00) 00010000:00010000:2.0:1715205776.260530:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.260531:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9a640, rc 0) 00010000:00000080:2.0:1715205776.260534:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce7f6c0 x1798520455779520/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.260554:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+200:11754:x1798520455779520:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 971us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.260559:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1944 00000100:00100000:2.0:1715205776.261688:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.261732:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455779712 00000100:00100000:3.0:1715205776.261764:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1945 00000100:00100000:3.0:1715205776.261768:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+200:11754:x1798520455779712:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.261777:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.261790:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305007aa8 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23982 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.261832:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007aaf lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.261841:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500777c lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2384e expref: 201 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.261845:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007aaf lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.261861:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500777c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2384e expref: 201 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.261871:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500777c lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2384e expref: 201 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.261879:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6def6c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035584:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.261911:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a6ea0b40 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.262615:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6def6c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035584:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.262642:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007aaf lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.262829:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.262873:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455779776 00010000:00010000:0.0:1715205776.262885:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500777c lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2384e expref: 202 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.262900:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4773 00000100:00100000:0.0:1715205776.262903:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7b900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+202:1829:x1798520455779776:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1715205776.262908:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.262911:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500777c lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2384e expref: 202 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.262917:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500777c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2384e expref: 202 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.262927:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170480/0xb608af430500777c lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2384e expref: 202 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.262934:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee6:0x0].0x0 (ffff88008f367800) 00010000:00010000:0.0:1715205776.262937:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007aaf lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.262942:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007aaf lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.262947:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007aaf lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.262958:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.262961:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007aaf lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.262967:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007aaf lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.262976:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee6:0x0]: returning size 260096 00000100:00100000:0.0:1715205776.262984:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7b900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+201:1829:x1798520455779776:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 80us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.263001:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4773 00010000:00010000:2.0:1715205776.263042:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305007aa8 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23982 expref: 202 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.263053:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007aaf lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23982 expref: 201 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.263058:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee6:0x0].0x0 (ffff88008f367800) 00010000:00010000:2.0:1715205776.263059:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.263061:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73afa80, rc 0) 00010000:00000080:2.0:1715205776.263063:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce78000 x1798520455779712/t330712482679(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.263094:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+201:11754:x1798520455779712:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1325us (1408us total) trans 330712482679 rc 0/0 00000100:00100000:2.0:1715205776.263121:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1945 00000100:00100000:2.0:1715205776.264961:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.264997:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455779840 00000100:00100000:0.0:1715205776.265025:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1946 00000100:00100000:0.0:1715205776.265029:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+201:11754:x1798520455779840:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.265039:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.265046:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007abd lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23989 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.265075:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305007ac4 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.265084:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007aaf lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23982 expref: 202 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.265089:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305007ac4 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.265105:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007aaf lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23982 expref: 202 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.265113:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007aaf lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23982 expref: 202 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.265121:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035648:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.265156:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b50f300 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.266028:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.266038:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6a4ed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035648:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.266050:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305007ac4 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.266055:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455779904 00010000:00010000:0.0:1715205776.266079:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007aaf lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23982 expref: 203 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.266109:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4774 00000100:00100000:0.0:1715205776.266113:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a49c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+203:1828:x1798520455779904:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1715205776.266122:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.266126:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007aaf lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23982 expref: 203 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.266135:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007aaf lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23982 expref: 203 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.266150:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007aaf lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23982 expref: 203 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.266231:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee6:0x0].0x0 (ffff88008f367800) 00010000:00010000:0.0:1715205776.266234:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305007ac4 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.266244:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305007ac4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.266249:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305007ac4 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.266269:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.266295:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a49c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+202:1828:x1798520455779904:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 180us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.266301:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4774 00010000:00010000:1.0:1715205776.266364:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305007ac4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.266371:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305007ac4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205776.266394:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee6:0x0]: returning size 260096 00000004:00200000:1.0:1715205776.266396:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205776.266407:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305007ac4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.266413:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305007ac4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.266427:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007abd lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23989 expref: 202 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.266436:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305007ac4 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23989 expref: 201 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.266441:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee6:0x0].0x0 (ffff88008f367800) 00010000:00010000:1.0:1715205776.266443:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205776.266444:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59e1c0, rc 0) 00010000:00000080:1.0:1715205776.266447:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce7aac0 x1798520455779840/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.266472:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+201:11754:x1798520455779840:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1443us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.266478:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1946 00000100:00100000:0.0:1715205776.267701:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.268073:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455780032 00000100:00100000:1.0:1715205776.268111:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1947 00000100:00100000:1.0:1715205776.268115:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+201:11754:x1798520455780032:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.268131:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.268140:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007acb lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23990 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.268189:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007ad2 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.268199:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500779f lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2385c expref: 202 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.268204:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007ad2 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.268221:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500779f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2385c expref: 202 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.268229:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500779f lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2385c expref: 202 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.268236:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035712:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.268279:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f2900 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.272280:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035712:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.272298:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007ad2 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.272346:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.272384:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455780096 00010000:00010000:1.0:1715205776.272405:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500779f lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2385c expref: 203 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.272433:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4775 00000100:00100000:1.0:1715205776.272437:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4ed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+203:1830:x1798520455780096:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1715205776.272446:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.272450:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500779f lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2385c expref: 203 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.272457:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500779f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2385c expref: 203 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.272472:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af430500779f lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2385c expref: 203 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.272482:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee7:0x0].0x0 (ffff88008f367600) 00010000:00010000:1.0:1715205776.272484:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007ad2 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.272489:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007ad2 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.272494:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007ad2 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.272514:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.272530:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007ad2 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.272537:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007ad2 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.272539:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4ed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+202:1830:x1798520455780096:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 101us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.272545:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4775 00000004:00200000:0.0:1715205776.272552:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee7:0x0]: returning size 260096 00010000:00010000:0.0:1715205776.272689:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007acb lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23990 expref: 203 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.272701:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007ad2 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23990 expref: 202 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.272706:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee7:0x0].0x0 (ffff88008f367600) 00010000:00010000:0.0:1715205776.272707:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205776.272709:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd99f80, rc 0) 00010000:00000080:0.0:1715205776.272713:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6a4a140 x1798520455780032/t330712482680(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.272758:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+202:11754:x1798520455780032:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 4642us (5059us total) trans 330712482680 rc 0/0 00000100:00100000:0.0:1715205776.272764:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1947 00000100:00100000:0.0:1715205776.273574:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.273629:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455780160 00000100:00100000:1.0:1715205776.273657:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1948 00000100:00100000:1.0:1715205776.273661:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c224c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+202:11754:x1798520455780160:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.273674:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.273683:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af4305007ae0 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23997 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.273713:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007ae7 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.273719:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007ad2 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23990 expref: 203 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.273722:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007ae7 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.273752:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007ad2 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23990 expref: 203 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.273761:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007ad2 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23990 expref: 203 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.273769:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035776:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.273806:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f2900 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.275397:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.275404:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035776:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.275415:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007ae7 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.275458:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455780224 00010000:00010000:0.0:1715205776.275477:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007ad2 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23990 expref: 204 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.275500:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4776 00000100:00100000:0.0:1715205776.275504:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6deb900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+204:1830:x1798520455780224:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1715205776.275511:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.275514:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007ad2 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23990 expref: 204 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.275522:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007ad2 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23990 expref: 204 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.275532:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007ad2 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23990 expref: 204 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.275540:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee7:0x0].0x0 (ffff88008f367600) 00010000:00010000:0.0:1715205776.275543:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007ae7 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.275549:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007ae7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.275557:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007ae7 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.275576:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205776.275590:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007ae7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.275595:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007ae7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.275596:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6deb900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+203:1830:x1798520455780224:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 91us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.275601:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4776 00000004:00200000:1.0:1715205776.275636:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee7:0x0]: returning size 260096 00000004:00200000:1.0:1715205776.275639:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205776.275647:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007ae7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.275653:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007ae7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.275663:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af4305007ae0 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23997 expref: 203 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.275669:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007ae7 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23997 expref: 202 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.275672:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee7:0x0].0x0 (ffff88008f367600) 00010000:00010000:1.0:1715205776.275673:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205776.275674:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9af40, rc 0) 00010000:00000080:1.0:1715205776.275681:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c224c00 x1798520455780160/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.275700:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c224c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+202:11754:x1798520455780160:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2040us (2132us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.275704:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1948 00000100:00100000:3.0:1715205776.283214:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.283285:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455780352 00000100:00100000:1.0:1715205776.283322:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1949 00000100:00100000:1.0:1715205776.283326:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6deb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+202:11754:x1798520455780352:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.283340:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.283354:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007aee lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b2399e expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.283421:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007af5 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.283432:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050077c2 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2386a expref: 203 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.283437:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007af5 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.283462:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050077c2 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2386a expref: 203 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.283471:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050077c2 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2386a expref: 203 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.283480:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035840:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.283535:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f2900 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.284865:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372fed40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035840:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.284866:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:0.0:1715205776.284880:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007af5 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.284925:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455780416 00010000:00010000:1.0:1715205776.284940:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050077c2 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2386a expref: 204 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.284972:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4777 00000100:00100000:1.0:1715205776.284976:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce78980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+204:1828:x1798520455780416:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1715205776.284983:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.284987:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050077c2 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2386a expref: 204 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.284994:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050077c2 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2386a expref: 204 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.285005:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af43050077c2 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2386a expref: 204 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.285028:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee8:0x0].0x0 (ffff88009399e700) 00010000:00010000:1.0:1715205776.285031:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007af5 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.285037:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007af5 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.285042:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007af5 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.285060:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.285087:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007af5 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.285088:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce78980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+203:1828:x1798520455780416:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 111us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.285093:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4777 00010000:00010000:0.0:1715205776.285099:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007af5 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.285111:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee8:0x0]: returning size 260096 00010000:00010000:0.0:1715205776.285202:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007aee lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2399e expref: 204 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.285212:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007af5 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2399e expref: 203 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.285218:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee8:0x0].0x0 (ffff88009399e700) 00010000:00010000:0.0:1715205776.285220:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205776.285221:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd998c0, rc 0) 00010000:00000080:0.0:1715205776.285225:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6deb440 x1798520455780352/t330712482681(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.285261:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6deb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+203:11754:x1798520455780352:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1934us (2052us total) trans 330712482681 rc 0/0 00000100:00100000:0.0:1715205776.285267:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1949 00000100:00100000:2.0:1715205776.286777:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.286845:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455780480 00000100:00100000:0.0:1715205776.286891:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1950 00000100:00100000:0.0:1715205776.286894:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+203:11754:x1798520455780480:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.286911:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.286925:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007b03 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b239a5 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.286965:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007b0a lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.286974:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007af5 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2399e expref: 204 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.286978:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007b0a lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.286998:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007af5 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2399e expref: 204 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.287006:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007af5 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2399e expref: 204 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.287013:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035904:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.287064:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b50f300 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.287874:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035904:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.287890:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007b0a lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.288381:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.288460:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455780544 00010000:00010000:1.0:1715205776.288490:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007af5 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2399e expref: 205 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.288523:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4778 00000100:00100000:1.0:1715205776.288528:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+205:1829:x1798520455780544:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1715205776.288538:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.288541:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007af5 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2399e expref: 205 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.288549:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007af5 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2399e expref: 205 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.288562:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007af5 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2399e expref: 205 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.288572:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee8:0x0].0x0 (ffff88009399e700) 00010000:00010000:1.0:1715205776.288575:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007b0a lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.288581:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007b0a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.288586:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007b0a lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.288610:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.288645:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007b0a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.288654:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007b0a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.288678:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+204:1829:x1798520455780544:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 150us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.288685:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4778 00000004:00200000:0.0:1715205776.288687:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee8:0x0]: returning size 260096 00000004:00200000:0.0:1715205776.288690:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205776.288702:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007b0a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.288709:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007b0a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.288733:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007b03 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239a5 expref: 204 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.288757:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007b0a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239a5 expref: 203 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.288763:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee8:0x0].0x0 (ffff88009399e700) 00010000:00010000:0.0:1715205776.288765:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205776.288766:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59c000, rc 0) 00010000:00000080:0.0:1715205776.288770:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce7e880 x1798520455780480/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.288792:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+203:11754:x1798520455780480:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1897us (2020us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.288798:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1950 00000100:00100000:2.0:1715205776.290395:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.290457:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455780672 00000100:00100000:0.0:1715205776.290486:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1951 00000100:00100000:0.0:1715205776.290489:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+203:11754:x1798520455780672:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.290501:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.290512:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305007b11 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b239ac expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.290566:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305007b18 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.290577:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af43050077e5 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23878 expref: 204 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.290582:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305007b18 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.290605:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af43050077e5 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23878 expref: 204 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.290614:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af43050077e5 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23878 expref: 204 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.290664:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035968:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.290715:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b50f300 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.291499:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.291555:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455780736 00010000:00010000:1.0:1715205776.291569:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af43050077e5 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23878 expref: 205 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.291571:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456035968:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.291590:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305007b18 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.291597:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4779 00000100:00100000:1.0:1715205776.291601:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1f3a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+205:1830:x1798520455780736:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1715205776.291608:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.291694:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af43050077e5 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23878 expref: 205 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.291704:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af43050077e5 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23878 expref: 205 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.291715:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af43050077e5 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23878 expref: 205 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.291725:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee9:0x0].0x0 (ffff88009399e100) 00010000:00010000:1.0:1715205776.291728:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305007b18 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.291733:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305007b18 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.291748:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305007b18 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.291769:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205776.291794:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1f3a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+204:1830:x1798520455780736:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 192us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.291802:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4779 00010000:00010000:0.0:1715205776.291871:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305007b18 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.291877:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305007b18 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.291887:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee9:0x0]: returning size 260096 00010000:00010000:0.0:1715205776.291981:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305007b11 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239ac expref: 205 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.291990:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305007b18 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239ac expref: 204 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.291994:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee9:0x0].0x0 (ffff88009399e100) 00010000:00010000:0.0:1715205776.291996:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205776.291997:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59dd40, rc 0) 00010000:00000080:0.0:1715205776.292001:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce7d0c0 x1798520455780672/t330712482682(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.292022:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+204:11754:x1798520455780672:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1533us (1630us total) trans 330712482682 rc 0/0 00000100:00100000:0.0:1715205776.292027:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1951 00000100:00100000:3.0:1715205776.293085:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.293137:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455780800 00000100:00100000:0.0:1715205776.293181:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1952 00000100:00100000:0.0:1715205776.293186:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6deaf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+204:11754:x1798520455780800:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.293205:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.293219:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59cb40/0xb608af4305007b26 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b239b3 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.293263:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305007b2d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.293274:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305007b18 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239ac expref: 205 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.293279:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305007b2d lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.293303:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305007b18 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239ac expref: 205 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.293313:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305007b18 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239ac expref: 205 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.293322:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456036032:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.293411:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b50f300 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.294329:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456036032:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.294342:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305007b2d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.294543:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.294588:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455780864 00010000:00010000:1.0:1715205776.294603:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305007b18 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239ac expref: 206 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.294647:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4780 00000100:00100000:3.0:1715205776.294652:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6debdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:1831:x1798520455780864:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1715205776.294661:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.294665:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305007b18 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239ac expref: 206 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.294672:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305007b18 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239ac expref: 206 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.294684:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305007b18 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239ac expref: 206 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.294705:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee9:0x0].0x0 (ffff88009399e100) 00010000:00010000:3.0:1715205776.294707:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305007b2d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.294717:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305007b2d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.294721:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305007b2d lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.294748:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205776.294767:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6debdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+205:1831:x1798520455780864:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 115us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.294772:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4780 00010000:00010000:0.0:1715205776.294787:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305007b2d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.294794:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305007b2d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.294861:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee9:0x0]: returning size 260096 00000004:00200000:0.0:1715205776.294865:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205776.294877:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305007b2d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.294886:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305007b2d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.294902:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59cb40/0xb608af4305007b26 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239b3 expref: 205 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.294912:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305007b2d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239b3 expref: 204 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.294917:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee9:0x0].0x0 (ffff88009399e100) 00010000:00010000:0.0:1715205776.294918:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205776.294920:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59f180, rc 0) 00010000:00000080:0.0:1715205776.294923:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6deaf80 x1798520455780800/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.294944:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6deaf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+204:11754:x1798520455780800:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1759us (1862us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.294949:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1952 00000100:00100000:2.0:1715205776.296584:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.296642:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455780992 00000100:00100000:0.0:1715205776.296675:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1953 00000100:00100000:0.0:1715205776.296679:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce79300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+204:11754:x1798520455780992:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.296691:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.296702:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305007b34 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b239ba expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.296772:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b3b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.296782:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af43050078da lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238da expref: 205 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.296790:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b3b lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.296810:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af43050078da lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238da expref: 205 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.296818:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af43050078da lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238da expref: 205 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.296826:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456036096:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.296862:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b50f300 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.297660:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456036096:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.297674:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b3b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.297898:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.297971:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455781056 00010000:00010000:3.0:1715205776.297987:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af43050078da lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238da expref: 206 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.298011:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4781 00000100:00100000:3.0:1715205776.298014:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7b900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:1831:x1798520455781056:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1715205776.298023:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.298026:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af43050078da lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238da expref: 206 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.298033:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af43050078da lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238da expref: 206 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.298044:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af43050078da lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b238da expref: 206 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.298444:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeeb:0x0].0x0 (ffff88008f367f00) 00010000:00010000:3.0:1715205776.298448:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b3b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.298455:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b3b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.298460:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b3b lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.298485:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.298521:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b3b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.298522:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7b900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+205:1831:x1798520455781056:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 506us (625us total) trans 0 rc 0/0 00010000:00010000:0.0:1715205776.298528:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b3b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.298528:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4781 00000004:00200000:0.0:1715205776.298545:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeeb:0x0]: returning size 260096 00010000:00010000:0.0:1715205776.298664:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305007b34 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239ba expref: 206 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.298675:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b3b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239ba expref: 205 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.298680:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeeb:0x0].0x0 (ffff88008f367f00) 00010000:00010000:0.0:1715205776.298687:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205776.298689:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59d200, rc 0) 00010000:00000080:0.0:1715205776.298693:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce79300 x1798520455780992/t330712482683(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.298718:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce79300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+205:11754:x1798520455780992:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2037us (2136us total) trans 330712482683 rc 0/0 00000100:00100000:0.0:1715205776.298724:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1953 00000100:00100000:2.0:1715205776.299732:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.299847:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455781120 00000100:00100000:3.0:1715205776.299909:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1954 00000100:00100000:3.0:1715205776.299913:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce78980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+205:11754:x1798520455781120:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.299926:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.299935:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007b49 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b239c1 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.299966:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305007b50 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.299974:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b3b lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239ba expref: 206 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.299980:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305007b50 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.299998:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b3b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239ba expref: 206 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.300007:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b3b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239ba expref: 206 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.300015:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6dec280 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456036160:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.300052:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a6ea0000 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.300912:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6dec280 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456036160:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.300925:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305007b50 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.301265:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.301403:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455781184 00010000:00010000:3.0:1715205776.301418:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b3b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239ba expref: 207 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.301437:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4782 00000100:00100000:3.0:1715205776.301440:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+207:1830:x1798520455781184:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205776.301445:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.301448:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b3b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239ba expref: 207 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.301452:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b3b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239ba expref: 207 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.301460:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b3b lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239ba expref: 207 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.301468:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeeb:0x0].0x0 (ffff88008f367f00) 00010000:00010000:3.0:1715205776.301471:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305007b50 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.301475:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305007b50 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.301478:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305007b50 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.301491:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.301512:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305007b50 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.301517:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:1830:x1798520455781184:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 77us (254us total) trans 0 rc 0/0 00010000:00010000:0.0:1715205776.301518:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305007b50 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.301522:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4782 00000004:00200000:0.0:1715205776.301543:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeeb:0x0]: returning size 260096 00000004:00200000:0.0:1715205776.301546:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205776.301585:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305007b50 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.301592:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305007b50 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.301609:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007b49 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239c1 expref: 206 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.301656:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305007b50 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239c1 expref: 205 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.301661:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeeb:0x0].0x0 (ffff88008f367f00) 00010000:00010000:0.0:1715205776.301663:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205776.301665:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ac000, rc 0) 00010000:00000080:0.0:1715205776.301668:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce78980 x1798520455781120/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.301688:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce78980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+205:11754:x1798520455781120:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1775us (1958us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.301693:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1954 00000100:00100000:2.0:1715205776.303129:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.303178:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455781312 00000100:00100000:0.0:1715205776.303204:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1955 00000100:00100000:0.0:1715205776.303207:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+205:11754:x1798520455781312:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.303217:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.303226:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af4305007b57 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b239c8 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.303279:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305007b5e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.303289:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305007808 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23886 expref: 206 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.303298:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305007b5e lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.303319:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305007808 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23886 expref: 206 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.303328:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305007808 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23886 expref: 206 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.303336:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456036224:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.303375:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b50f300 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.304497:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456036224:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.304497:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:0.0:1715205776.304519:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305007b5e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.304600:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455781376 00010000:00010000:3.0:1715205776.304663:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305007808 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23886 expref: 207 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.304695:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4783 00000100:00100000:3.0:1715205776.304698:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+207:1831:x1798520455781376:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1715205776.304707:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.304710:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305007808 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23886 expref: 207 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.304717:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305007808 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23886 expref: 207 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.305372:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305007808 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23886 expref: 207 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.305391:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeea:0x0].0x0 (ffff88012e817a00) 00010000:00010000:3.0:1715205776.305395:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305007b5e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.305402:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305007b5e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.305408:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305007b5e lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.305434:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.305458:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305007b5e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.305466:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305007b5e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.305480:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeea:0x0]: returning size 260096 00000100:00100000:3.0:1715205776.305482:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:1831:x1798520455781376:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 781us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.305491:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4783 00010000:00010000:0.0:1715205776.305579:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af4305007b57 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239c8 expref: 207 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.305590:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305007b5e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239c8 expref: 206 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.305599:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeea:0x0].0x0 (ffff88012e817a00) 00010000:00010000:0.0:1715205776.305601:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205776.305602:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59e640, rc 0) 00010000:00000080:0.0:1715205776.305606:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013711d580 x1798520455781312/t330712482684(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.305651:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:11754:x1798520455781312:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2443us (2528us total) trans 330712482684 rc 0/0 00000100:00100000:0.0:1715205776.305657:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1955 00000100:00100000:2.0:1715205776.306701:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.306770:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455781440 00000100:00100000:0.0:1715205776.306799:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1956 00000100:00100000:0.0:1715205776.306806:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:11754:x1798520455781440:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.306819:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.306829:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305007b6c lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b239cf expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.306861:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af4305007b73 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.306872:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305007b5e lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239c8 expref: 207 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.306877:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af4305007b73 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.306898:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305007b5e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239c8 expref: 207 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.306910:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305007b5e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239c8 expref: 207 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.306919:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012c220000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456036288:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.306958:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b50f300 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.307875:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012c220000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456036288:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.307888:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af4305007b73 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.308103:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.308152:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455781504 00010000:00010000:1.0:1715205776.308168:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305007b5e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239c8 expref: 208 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.308194:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4784 00000100:00100000:1.0:1715205776.308198:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+208:1830:x1798520455781504:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1715205776.308205:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.308209:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305007b5e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239c8 expref: 208 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.308215:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305007b5e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239c8 expref: 208 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.308226:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305007b5e lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239c8 expref: 208 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.308244:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeea:0x0].0x0 (ffff88012e817a00) 00010000:00010000:1.0:1715205776.308246:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af4305007b73 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.308252:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af4305007b73 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.308261:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af4305007b73 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.308275:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.308279:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af4305007b73 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.308284:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af4305007b73 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.308300:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+207:1830:x1798520455781504:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 102us (200us total) trans 0 rc 0/0 00000004:00200000:0.0:1715205776.308304:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeea:0x0]: returning size 260096 00000100:00100000:1.0:1715205776.308304:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4784 00000004:00200000:0.0:1715205776.308306:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205776.308314:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af4305007b73 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.308319:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af4305007b73 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.308330:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305007b6c lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239cf expref: 207 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.308336:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af4305007b73 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239cf expref: 206 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.308342:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeea:0x0].0x0 (ffff88012e817a00) 00010000:00010000:0.0:1715205776.308343:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205776.308345:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59c6c0, rc 0) 00010000:00000080:0.0:1715205776.308348:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801371197c0 x1798520455781440/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.308372:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801371197c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:11754:x1798520455781440:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1565us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.308377:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1956 00000100:00100000:2.0:1715205776.309509:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.309552:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455781568 00000100:00100000:0.0:1715205776.309574:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1957 00000100:00100000:0.0:1715205776.309577:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880137119300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:11754:x1798520455781568:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.309587:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.309594:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59cb40/0xb608af4305007b7a lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b239d6 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.309643:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305007b81 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.309651:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305007b81 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.309657:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305007b81 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.309668:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007b88 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.309676:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007b88 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.309681:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007b88 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.309751:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305007b81 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.309757:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305007b81 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.309762:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305007b81 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.309767:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59ed00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.309769:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305007b81 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.309774:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305007b81 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.309782:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.309783:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.309786:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305007b81 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.309790:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305007b81 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.309801:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007b88 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.309805:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007b88 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.309809:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007b88 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.309812:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59db00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.309814:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007b88 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.309818:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007b88 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.309824:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x63bf9fee (ffff880135bf2c00) 00010000:00010000:0.0:1715205776.309825:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.309826:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007b88 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.309830:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305007b88 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.309859:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59cb40/0xb608af4305007b7a lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239d6 expref: 207 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.309865:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59cb40/0xb608af4305007b7a lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239d6 expref: 207 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.309872:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59cb40, rc 0) 00010000:00000080:0.0:1715205776.309875:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880137119300 x1798520455781568/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.309914:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880137119300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:11754:x1798520455781568:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 335us (406us total) trans 0 rc 301/301 00000100:00100000:0.0:1715205776.309919:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1957 00000100:00100000:2.0:1715205776.312043:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.312103:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455781632 00000100:00100000:0.0:1715205776.312127:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1958 00000100:00100000:0.0:1715205776.312131:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:11754:x1798520455781632:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.312141:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.312151:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305007b8f lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b239dd expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.312183:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b96 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.312192:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b96 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.312199:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b96 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.312209:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af4305007b9d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.312214:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af4305007b9d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.312222:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af4305007b9d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.312262:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b96 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.312268:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b96 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.312272:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b96 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.312275:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59d200 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.312277:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b96 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.312282:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b96 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.312288:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.312290:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.312291:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b96 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.312295:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305007b96 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.312302:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af4305007b9d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.312310:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af4305007b9d lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.312314:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af4305007b9d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.312317:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedfa80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.312319:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af4305007b9d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.312322:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af4305007b9d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.312327:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x640c9ef0 (ffff880135bf2a00) 00010000:00010000:0.0:1715205776.312329:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.312330:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af4305007b9d lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.312334:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af4305007b9d lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.312360:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305007b8f lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239dd expref: 207 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.312365:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305007b8f lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239dd expref: 207 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.312371:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59dd40, rc 0) 00010000:00000080:0.0:1715205776.312375:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013711df00 x1798520455781632/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.312409:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:11754:x1798520455781632:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 277us (370us total) trans 0 rc 301/301 00000100:00100000:0.0:1715205776.312414:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1958 00000100:00100000:2.0:1715205776.313550:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.313590:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455781760 00000100:00100000:0.0:1715205776.313648:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1959 00000100:00100000:0.0:1715205776.313653:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:11754:x1798520455781760:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.313660:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.313668:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af4305007ba4 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b239e4 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.313720:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af4305007bab lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.313728:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af4305007bab lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.313748:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af4305007bab lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.313756:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305007bb2 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.313761:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305007bb2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.313766:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305007bb2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.313793:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af4305007bab lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.313798:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af4305007bab lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.313802:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af4305007bab lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.313806:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedc900 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.313808:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af4305007bab lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.313812:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af4305007bab lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.313818:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.313820:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.313822:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af4305007bab lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.313826:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af4305007bab lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.313831:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305007bb2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.313835:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305007bb2 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.313842:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305007bb2 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.313845:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedc6c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.313846:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305007bb2 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.313849:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305007bb2 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.313852:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x640c9ef0 (ffff880135bf2600) 00010000:00010000:0.0:1715205776.313854:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.313854:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305007bb2 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.313858:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305007bb2 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.313875:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af4305007ba4 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239e4 expref: 207 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.313880:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af4305007ba4 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239e4 expref: 207 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.313884:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedeac0, rc 0) 00010000:00000080:0.0:1715205776.313887:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013711f200 x1798520455781760/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 656/600 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.313922:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:11754:x1798520455781760:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 269us (375us total) trans 0 rc 301/301 00000100:00100000:0.0:1715205776.313928:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1959 00000100:00100000:2.0:1715205776.314958:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.315040:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455781824 00000100:00100000:0.0:1715205776.315073:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1960 00000100:00100000:0.0:1715205776.315077:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:11754:x1798520455781824:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.315091:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.315106:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc480/0xb608af4305007bb9 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b239eb expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.315146:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007bc0 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.315156:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007bc0 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.315164:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007bc0 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.315176:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007bc7 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.315181:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007bc7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.315186:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007bc7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.315245:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007bc0 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.315255:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007bc0 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.315259:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007bc0 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.315264:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedc000 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.315267:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007bc0 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.315272:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007bc0 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.315281:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.315283:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.315285:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007bc0 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.315289:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af4305007bc0 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.315300:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007bc7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.315304:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007bc7 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.315308:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007bc7 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.315316:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedef40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.315317:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007bc7 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.315320:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007bc7 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.315324:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x63bf9fee (ffff880135bf2300) 00010000:00010000:0.0:1715205776.315325:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.315326:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007bc7 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.315330:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305007bc7 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.315361:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc480/0xb608af4305007bb9 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239eb expref: 207 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.315366:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc480/0xb608af4305007bb9 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239eb expref: 207 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.315373:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedc480, rc 0) 00010000:00000080:0.0:1715205776.315377:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013711da40 x1798520455781824/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.315425:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:11754:x1798520455781824:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 346us (470us total) trans 0 rc 301/301 00000100:00100000:0.0:1715205776.315431:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1960 00000100:00100000:2.0:1715205776.316359:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.316402:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455781952 00000100:00100000:0.0:1715205776.316432:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1961 00000100:00100000:0.0:1715205776.316437:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:11754:x1798520455781952:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.316445:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.316454:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af4305007bce lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b239f2 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.316507:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af4305007bd5 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.316514:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af4305007bd5 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.316521:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af4305007bd5 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.316529:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007bdc lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.316535:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007bdc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.316539:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007bdc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.316562:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af4305007bd5 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.316567:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af4305007bd5 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.316575:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af4305007bd5 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.316579:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedf600 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.316581:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af4305007bd5 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.316585:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af4305007bd5 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.316590:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.316592:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.316593:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af4305007bd5 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.316597:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af4305007bd5 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.316604:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007bdc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.316608:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007bdc lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.316612:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007bdc lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.316641:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedcb40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.316643:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007bdc lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.316648:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007bdc lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.316655:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x63bf9fee (ffff880135bf2b00) 00010000:00010000:0.0:1715205776.316657:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.316658:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007bdc lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.316663:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af4305007bdc lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.316785:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af4305007bce lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239f2 expref: 207 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.316792:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af4305007bce lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239f2 expref: 207 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.316799:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedfcc0, rc 0) 00010000:00000080:0.0:1715205776.316803:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013711ed40 x1798520455781952/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 656/600 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.316845:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:11754:x1798520455781952:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 408us (489us total) trans 0 rc 301/301 00000100:00100000:0.0:1715205776.316851:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1961 00000100:00100000:2.0:1715205776.317971:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.318013:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455782016 00000100:00100000:0.0:1715205776.318041:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1962 00000100:00100000:0.0:1715205776.318046:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:11754:x1798520455782016:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.318057:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.318064:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af4305007be3 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b239f9 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.318095:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af4305007bea lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.318103:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af4305007bea lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.318110:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af4305007bea lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.318120:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007bf1 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.318125:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007bf1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.318130:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007bf1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.318159:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af4305007bea lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.318163:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af4305007bea lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.318167:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af4305007bea lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.318175:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eede640 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.318177:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af4305007bea lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.318181:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af4305007bea lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.318186:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.318188:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.318190:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af4305007bea lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.318193:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af4305007bea lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.318201:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007bf1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.318204:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007bf1 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.318208:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007bf1 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.318212:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83eac0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.318213:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007bf1 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.318216:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007bf1 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.318221:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x640c9ef0 (ffff880135bf2100) 00010000:00010000:0.0:1715205776.318223:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.318225:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007bf1 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.318228:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007bf1 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.318250:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af4305007be3 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239f9 expref: 207 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.318255:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af4305007be3 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239f9 expref: 207 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.318260:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eeddb00, rc 0) 00010000:00000080:0.0:1715205776.318263:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013711af80 x1798520455782016/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.318302:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:11754:x1798520455782016:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 256us (333us total) trans 0 rc 301/301 00000100:00100000:0.0:1715205776.318308:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1962 00000100:00100000:3.0:1715205776.319529:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.319599:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455782144 00000100:00100000:0.0:1715205776.319645:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1963 00000100:00100000:0.0:1715205776.319649:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6dec280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:11754:x1798520455782144:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.319658:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.319667:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007bf8 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23a00 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.319720:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305007bff lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.319728:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305007bff lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.319750:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305007bff lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.319760:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c6c0/0xb608af4305007c06 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.319765:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c6c0/0xb608af4305007c06 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.319771:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c6c0/0xb608af4305007c06 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.320094:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305007bff lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.320100:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305007bff lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.320104:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305007bff lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.320108:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83e400 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.320109:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305007bff lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.320115:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305007bff lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.320121:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.320123:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.320125:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305007bff lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.320129:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305007bff lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.320137:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c6c0/0xb608af4305007c06 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.320141:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c6c0/0xb608af4305007c06 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.320145:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c6c0/0xb608af4305007c06 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.320149:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83c6c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.320151:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c6c0/0xb608af4305007c06 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.320155:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c6c0/0xb608af4305007c06 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.320160:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x640c9ef0 (ffff880135bf2200) 00010000:00010000:0.0:1715205776.320162:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.320164:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c6c0/0xb608af4305007c06 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.320168:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c6c0/0xb608af4305007c06 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.320189:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007bf8 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a00 expref: 207 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.320195:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007bf8 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a00 expref: 207 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.320201:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83cb40, rc 0) 00010000:00000080:0.0:1715205776.320204:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6dec280 x1798520455782144/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 656/600 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.320246:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6dec280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:11754:x1798520455782144:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 596us (718us total) trans 0 rc 301/301 00000100:00100000:0.0:1715205776.320251:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1963 00000100:00100000:2.0:1715205776.322584:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.322657:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455782208 00000100:00100000:0.0:1715205776.322708:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1964 00000100:00100000:0.0:1715205776.322714:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:11754:x1798520455782208:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.322727:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.322752:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007c0d lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23a07 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.322795:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305007c14 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.322806:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305007c14 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.322815:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305007c14 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.322825:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305007c1b lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.322831:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305007c1b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.322835:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305007c1b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.322886:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305007c14 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.322891:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305007c14 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.322896:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305007c14 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.322901:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83dd40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.322904:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305007c14 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.322909:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305007c14 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.322918:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.322921:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.322923:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305007c14 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.322927:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305007c14 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.322936:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305007c1b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.322940:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305007c1b lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.322944:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305007c1b lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.322948:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83d440 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.322949:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305007c1b lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.322954:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305007c1b lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.322959:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x63bf9fee (ffff880130676400) 00010000:00010000:0.0:1715205776.322961:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.322962:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305007c1b lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.322966:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305007c1b lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.323002:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007c0d lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a07 expref: 207 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.323008:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007c0d lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a07 expref: 207 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.323015:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83f840, rc 0) 00010000:00000080:0.0:1715205776.323019:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013711c280 x1798520455782208/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.323069:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:11754:x1798520455782208:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 355us (489us total) trans 0 rc 301/301 00000100:00100000:0.0:1715205776.323135:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1964 00000100:00100000:2.0:1715205776.324380:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.324431:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455782336 00000100:00100000:0.0:1715205776.324471:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1965 00000100:00100000:0.0:1715205776.324476:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:11754:x1798520455782336:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.324489:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.324491:0:14860:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1715205776.324511:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007974 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23904 expref: 206 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.324525:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.324528:0:14860:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.324536:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305007c22 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23a0e expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.324648:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007c29 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.324658:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007c29 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.324666:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007c29 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.324677:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007c30 lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.324682:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007c30 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.324687:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007c30 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715205776.325108:0:14860:0:(osp_object.c:1645:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x100000000:0x17bb:0x0], index 0: 0 00010000:00010000:0.0:1715205776.325217:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83ed00/0xb608af4305007c37 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.325222:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83ed00/0xb608af4305007c37 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.325226:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83ed00/0xb608af4305007c37 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.325245:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007c29 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.325248:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007c29 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.325252:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007c29 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.325255:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83c480 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.325257:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007c29 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.325260:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007c29 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.325264:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.325265:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.325266:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007c29 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.325268:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007c29 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715205776.325274:0:14860:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88013711d0c0 reply state ffff8800a62d7000 transno 330712482685 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007c30 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.325287:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305007c22 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a0e expref: 208 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.325295:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83ed00/0xb608af4305007c37 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a0e expref: 207 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.325298:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1015:0x0].0x0 (ffff88009ee7d600) 00010000:00010000:0.0:1715205776.325300:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1715205776.325301:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83ed00, rc 0) 00010000:00000080:0.0:1715205776.325305:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013711d0c0 x1798520455782336/t330712482685(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 656/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.325350:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+208:11754:x1798520455782336:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 874us (972us total) trans 330712482685 rc 0/0 00000100:00100000:0.0:1715205776.325354:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1965 00010000:00010000:3.0:1715205776.326246:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007c30 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.326258:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007c30 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.326264:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007c30 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.326269:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83cfc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205776.326272:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007c30 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.326280:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007c30 lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.326290:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x63bf9fee (ffff88009ee7dc00) 00010000:00010000:3.0:1715205776.326292:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205776.326294:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007c30 lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.326298:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007c30 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.326433:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.326476:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455782400 00000100:00100000:1.0:1715205776.326542:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1966 00000100:00100000:1.0:1715205776.326551:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6decc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+207:11754:x1798520455782400:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.326567:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.326577:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007c45 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23a15 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.326613:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007c4c lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.326637:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007c4c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.326645:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007c4c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205776.326667:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205776.326677:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007c4c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.326684:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007c4c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.326698:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007c45 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a15 expref: 209 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.326717:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007c4c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a15 expref: 208 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.326722:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1015:0x0].0x0 (ffff88009ee7d600) 00010000:00010000:1.0:1715205776.326724:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205776.326725:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd99f80, rc 0) 00010000:00000080:1.0:1715205776.326729:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6decc00 x1798520455782400/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.326770:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6decc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+208:11754:x1798520455782400:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 223us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.326776:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1966 00000100:00100000:2.0:1715205776.328555:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.328642:0:20898:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455782464 00000100:00100000:3.0:1715205776.328667:0:20898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14695 00000100:00100000:3.0:1715205776.328670:0:20898:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+40:1831:x1798520455782464:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.328678:0:20898:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.328689:0:20898:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a73af600/0xb608af4305007c53 lrc: 2/0,0 mode: --/PR res: [0x17bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23a1c expref: -99 pid: 20898 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1715205776.328705:0:20898:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x17bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1715205776.328715:0:20898:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205776.328716:0:20898:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205776.328722:0:20898:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a73af600/0xb608af4305007c53 lrc: 3/0,0 mode: PR/PR res: [0x17bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a1c expref: 41 pid: 20898 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715205776.328732:0:20898:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a73af600/0xb608af4305007c53 lrc: 3/0,0 mode: PR/PR res: [0x17bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a1c expref: 41 pid: 20898 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715205776.328758:0:20898:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73af600, rc 0) 00000100:00100000:3.0:1715205776.328790:0:20898:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+41:1831:x1798520455782464:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 119us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.328796:0:20898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14695 00000100:00100000:2.0:1715205776.330076:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.330121:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455782592 00000100:00100000:1.0:1715205776.330155:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 530 00000100:00100000:1.0:1715205776.330159:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+208:11754:x1798520455782592:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.330351:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880137119c80 x1798520455782592/t330712482686(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.330391:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+209:11754:x1798520455782592:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 232us (316us total) trans 330712482686 rc 0/0 00000100:00100000:1.0:1715205776.330397:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 530 00000100:00100000:2.0:1715205776.331567:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.331609:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455782720 00000100:00100000:1.0:1715205776.331660:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1967 00000100:00100000:1.0:1715205776.331664:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb4740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+209:11754:x1798520455782720:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.331674:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.331683:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af4305007c5a lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23a23 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.331731:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007c61 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.331754:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007c4c lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a15 expref: 210 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.331759:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007c61 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.331782:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007c4c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a15 expref: 210 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.331792:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007c4c lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a15 expref: 210 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.331802:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372faf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456036352:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.331846:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f2e40 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.332512:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372faf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456036352:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.332524:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007c61 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.332764:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.332819:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455782784 00010000:00010000:1.0:1715205776.332832:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007c4c lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a15 expref: 211 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.332857:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4785 00000100:00100000:1.0:1715205776.332860:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+211:1831:x1798520455782784:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1715205776.332867:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.332870:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007c4c lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a15 expref: 211 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.332876:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007c4c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a15 expref: 211 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.332887:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007c4c lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a15 expref: 211 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.332895:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1015:0x0].0x0 (ffff88009ee7d600) 00010000:00010000:1.0:1715205776.332899:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007c61 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.332904:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007c61 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.332913:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007c61 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.332937:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205776.332961:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+210:1831:x1798520455782784:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 101us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.332968:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4785 00010000:00010000:2.0:1715205776.333019:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007c61 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.333025:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007c61 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.333035:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1015:0x0]: returning size 0 00010000:00010000:2.0:1715205776.333108:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af4305007c5a lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a23 expref: 211 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.333128:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007c61 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a23 expref: 210 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.333133:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1015:0x0].0x0 (ffff88009ee7d600) 00010000:00010000:2.0:1715205776.333135:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.333137:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd98d80, rc 0) 00010000:00000080:2.0:1715205776.333140:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb4740 x1798520455782720/t330712482687(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.333172:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb4740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+210:11754:x1798520455782720:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1508us (1606us total) trans 330712482687 rc 0/0 00000100:00100000:2.0:1715205776.333177:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1967 00000100:00100000:2.0:1715205776.334106:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.334151:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455782848 00000100:00100000:3.0:1715205776.334172:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1968 00000100:00100000:3.0:1715205776.334175:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb2ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+210:11754:x1798520455782848:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.334184:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.334191:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305007c6f lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23a2a expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.334215:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305007c76 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.334421:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007c61 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a23 expref: 211 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.334426:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305007c76 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.334442:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007c61 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a23 expref: 211 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.334449:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007c61 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a23 expref: 211 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.334457:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6dec740 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456036416:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.334490:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a6ea0000 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.335820:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6dec740 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456036416:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.335832:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1715205776.335833:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305007c76 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.335852:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455782912 00010000:00010000:1.0:1715205776.335864:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007c61 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a23 expref: 212 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.335882:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4786 00000100:00100000:1.0:1715205776.335886:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+212:1830:x1798520455782912:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1715205776.335891:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.335895:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007c61 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a23 expref: 212 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.335902:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007c61 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a23 expref: 212 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.335913:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007c61 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a23 expref: 212 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.335919:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1015:0x0].0x0 (ffff88009ee7d600) 00010000:00010000:1.0:1715205776.335920:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305007c76 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.335924:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305007c76 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.335927:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305007c76 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.335946:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205776.335964:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+211:1830:x1798520455782912:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 78us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.335969:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4786 00010000:00010000:3.0:1715205776.336035:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305007c76 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.336043:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305007c76 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205776.336063:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1015:0x0]: returning size 0 00000004:00200000:3.0:1715205776.336066:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205776.336076:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305007c76 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.336083:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305007c76 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.336098:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305007c6f lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a2a expref: 211 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.336109:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305007c76 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a2a expref: 210 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.336113:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1015:0x0].0x0 (ffff88009ee7d600) 00010000:00010000:3.0:1715205776.336115:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205776.336116:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73aed00, rc 0) 00010000:00000080:3.0:1715205776.336119:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb2ac0 x1798520455782848/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.336151:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb2ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+210:11754:x1798520455782848:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1975us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.336156:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1968 00000100:00100000:0.0:1715205776.337204:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.337238:0:20898:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455782976 00000100:00100000:3.0:1715205776.337259:0:20898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14696 00000100:00100000:3.0:1715205776.337262:0:20898:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+41:11754:x1798520455782976:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.337269:0:20898:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.337277:0:20898:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af4305007c7d lrc: 2/0,0 mode: --/PW res: [0x17bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23a31 expref: -99 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.337290:0:20898:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a73af600/0xb608af4305007c53 lrc: 2/0,0 mode: PR/PR res: [0x17bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a1c expref: 42 pid: 20898 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715205776.337295:0:20898:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205776.337296:0:20898:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205776.337297:0:20898:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af4305007c7d lrc: 4/0,0 mode: --/PW res: [0x17bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a31 expref: 42 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.337306:0:20898:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a73af600/0xb608af4305007c53 lrc: 3/0,0 mode: PR/PR res: [0x17bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a1c expref: 42 pid: 20898 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715205776.337311:0:20898:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a73af600/0xb608af4305007c53 lrc: 4/0,0 mode: PR/PR res: [0x17bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a1c expref: 42 pid: 20898 timeout: 3136 lvb_type: 1 00000100:00100000:3.0:1715205776.337316:0:20898:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6dec740 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20898:1798520456036480:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.337343:0:20898:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a6ea0000 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.338108:0:20898:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6dec740 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:20898:1798520456036480:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.338179:0:20898:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af4305007c7d lrc: 3/0,0 mode: --/PW res: [0x17bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a31 expref: 42 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.338189:0:20898:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73adf80, rc 0) 00000100:00100000:0.0:1715205776.338209:0:20898:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+42:11754:x1798520455782976:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 945us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.338215:0:20898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14696 00000100:00100000:1.0:1715205776.338219:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.338233:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455783040 00010000:00010000:1.0:1715205776.338242:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a73af600/0xb608af4305007c53 lrc: 4/0,0 mode: PR/PR res: [0x17bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a1c expref: 42 pid: 20898 timeout: 3136 lvb_type: 1 00000100:00100000:1.0:1715205776.338262:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4787 00000100:00100000:1.0:1715205776.338265:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372faf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+42:1830:x1798520455783040:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1715205776.338270:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.338281:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a73af600/0xb608af4305007c53 lrc: 4/0,0 mode: PR/PR res: [0x17bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a1c expref: 42 pid: 20898 timeout: 3136 lvb_type: 1 00010000:00010000:1.0:1715205776.338288:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a73af600/0xb608af4305007c53 lrc: 3/0,0 mode: PR/PR res: [0x17bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a1c expref: 42 pid: 20898 timeout: 3136 lvb_type: 1 00010000:00010000:1.0:1715205776.338304:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a73af600/0xb608af4305007c53 lrc: 0/0,0 mode: --/PR res: [0x17bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a1c expref: 42 pid: 20898 timeout: 3136 lvb_type: 1 00010000:00010000:1.0:1715205776.338311:0:6662:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205776.338312:0:6662:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205776.338316:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af4305007c7d lrc: 2/0,0 mode: PW/PW res: [0x17bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a31 expref: 41 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.338321:0:6662:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af4305007c7d lrc: 3/0,0 mode: PW/PW res: [0x17bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a31 expref: 41 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.338333:0:6662:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af4305007c7d lrc: 3/0,0 mode: PW/PW res: [0x17bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a31 expref: 41 pid: 20898 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.338343:0:6662:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801372ff6c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6662:1798520456036544:192.168.204.8@tcp:105: 00000100:00100000:1.0:1715205776.338358:0:6662:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a73f2f00 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.339046:0:6662:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801372ff6c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6662:1798520456036544:192.168.204.8@tcp:105: 00010000:00010000:1.0:1715205776.339055:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205776.339069:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372faf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+41:1830:x1798520455783040:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 804us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.339074:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4787 00000100:00100000:2.0:1715205776.339368:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.339386:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455783168 00000100:00100000:1.0:1715205776.339406:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 531 00000100:00100000:1.0:1715205776.339409:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c01850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+210:11754:x1798520455783168:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.339575:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880093c01850 x1798520455783168/t330712482688(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.339603:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c01850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+211:11754:x1798520455783168:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 193us (237us total) trans 330712482688 rc 0/0 00000100:00100000:1.0:1715205776.339608:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 531 00000100:00100000:0.0:1715205776.340562:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.340600:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455783296 00000100:00100000:3.0:1715205776.340637:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1969 00000100:00100000:3.0:1715205776.340641:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c222f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+211:11754:x1798520455783296:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.340652:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.340662:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305007c84 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23a38 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.340710:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007c8b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.340719:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305007c76 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a2a expref: 212 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.340725:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007c8b lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.340756:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305007c76 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a2a expref: 212 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.340764:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305007c76 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a2a expref: 212 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.340771:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6deaac0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456036608:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.340802:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a6ea0180 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.341356:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6deaac0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456036608:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.341368:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007c8b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.341579:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.341637:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455783360 00010000:00010000:1.0:1715205776.341649:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305007c76 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a2a expref: 213 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.341675:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4788 00000100:00100000:1.0:1715205776.341678:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2276c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+213:1830:x1798520455783360:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1715205776.341685:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.341688:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305007c76 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a2a expref: 213 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.341695:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305007c76 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a2a expref: 213 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.341704:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305007c76 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a2a expref: 213 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.341712:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1015:0x0].0x0 (ffff88009ee7d600) 00010000:00010000:1.0:1715205776.341714:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007c8b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.341719:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007c8b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.341723:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007c8b lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.341745:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205776.341764:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007c8b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.341765:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2276c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+212:1830:x1798520455783360:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 86us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.341770:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4788 00010000:00010000:3.0:1715205776.341770:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007c8b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205776.341778:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1015:0x0]: returning size 2048 00010000:00010000:3.0:1715205776.341836:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305007c84 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a38 expref: 213 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.341847:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007c8b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a38 expref: 212 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.341852:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1015:0x0].0x0 (ffff88009ee7d600) 00010000:00010000:3.0:1715205776.341853:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1715205776.341855:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ad440, rc 0) 00010000:00000080:3.0:1715205776.341858:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c222f80 x1798520455783296/t330712482689(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.341883:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c222f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+212:11754:x1798520455783296:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1242us (1323us total) trans 330712482689 rc 0/0 00000100:00100000:3.0:1715205776.341887:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1969 00000100:00100000:0.0:1715205776.342719:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.342794:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455783424 00000100:00100000:2.0:1715205776.342818:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1970 00000100:00100000:2.0:1715205776.342821:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c224280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+212:11754:x1798520455783424:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.342831:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.342839:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af4305007c99 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23a3f expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.342864:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af4305007ca0 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.342871:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007c8b lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a38 expref: 213 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.342876:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af4305007ca0 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.342889:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007c8b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a38 expref: 213 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.342896:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007c8b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a38 expref: 213 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.342904:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009edb5580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456036672:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.342926:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b310c0 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.343591:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009edb5580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456036672:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.343602:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af4305007ca0 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.343644:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.343662:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455783488 00010000:00010000:1.0:1715205776.343673:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007c8b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a38 expref: 214 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.343695:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4789 00000100:00100000:1.0:1715205776.343698:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a18163c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+214:1831:x1798520455783488:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1715205776.343704:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.343707:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007c8b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a38 expref: 214 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.343713:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007c8b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a38 expref: 214 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.343722:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007c8b lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a38 expref: 214 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.343729:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1015:0x0].0x0 (ffff88009ee7d600) 00010000:00010000:1.0:1715205776.343731:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af4305007ca0 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.343747:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af4305007ca0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.343751:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af4305007ca0 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.343761:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.343770:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af4305007ca0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.343777:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af4305007ca0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.343778:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a18163c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+213:1831:x1798520455783488:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 79us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.343783:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4789 00000004:00200000:2.0:1715205776.343799:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1015:0x0]: returning size 2048 00000004:00200000:2.0:1715205776.343801:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.343810:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af4305007ca0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.343817:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af4305007ca0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.343829:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af4305007c99 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a3f expref: 213 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.343839:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af4305007ca0 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a3f expref: 212 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.343844:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1015:0x0].0x0 (ffff88009ee7d600) 00010000:00010000:2.0:1715205776.343846:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.343847:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fad9d40, rc 0) 00010000:00000080:2.0:1715205776.343850:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c224280 x1798520455783424/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.343873:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c224280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+212:11754:x1798520455783424:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1051us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.343878:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1970 00000100:00100000:0.0:1715205776.345375:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.345424:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455783552 00000100:00100000:2.0:1715205776.345455:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1971 00000100:00100000:2.0:1715205776.345459:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1817200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+212:11754:x1798520455783552:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.345467:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.345474:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af4305007ca7 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23a46 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.345495:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305007cae lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.345500:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305007cae lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.345505:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305007cae lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.345510:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af4305007cb5 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.345513:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af4305007cb5 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.345516:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af4305007cb5 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.345554:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305007cae lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.345557:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305007cae lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.345560:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305007cae lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.345563:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009fad8d80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.345566:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305007cae lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.345570:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305007cae lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.345577:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.345578:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.345580:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305007cae lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.345584:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305007cae lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.345592:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af4305007cb5 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.345596:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af4305007cb5 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.345600:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af4305007cb5 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.345604:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009fadb3c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.345605:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af4305007cb5 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.345609:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af4305007cb5 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.345614:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x52a89496 (ffff880092bfc000) 00010000:00010000:2.0:1715205776.345616:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.345633:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af4305007cb5 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.345637:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af4305007cb5 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.345662:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af4305007ca7 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a46 expref: 213 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.345668:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af4305007ca7 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a46 expref: 213 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.345673:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fadb600, rc 0) 00010000:00000080:2.0:1715205776.345676:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1817200 x1798520455783552/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.345709:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1817200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+212:11754:x1798520455783552:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 250us (336us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205776.345715:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1971 00000100:00100000:2.0:1715205776.346966:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.347057:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455783616 00000100:00100000:0.0:1715205776.347085:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1972 00000100:00100000:0.0:1715205776.347088:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+212:11754:x1798520455783616:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.347095:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.347102:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e1c0/0xb608af4305007cbc lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23a4d expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.347115:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e1c0/0xb608af4305007cbc lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a4d expref: 213 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.347122:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e1c0/0xb608af4305007cbc lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a4d expref: 213 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.347127:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.347128:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.347130:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83e1c0, rc 0) 00010000:00000080:0.0:1715205776.347132:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb5580 x1798520455783616/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 328/344 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.347153:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+213:11754:x1798520455783616:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 64us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.347157:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1972 00000100:00100000:0.0:1715205776.348879:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.349054:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455783680 00000100:00100000:1.0:1715205776.349079:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 532 00000100:00100000:1.0:1715205776.349083:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1814740 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+213:11754:x1798520455783680:12345-192.168.204.8@tcp:37:dbench.0 00010000:00000080:1.0:1715205776.350824:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1814740 x1798520455783680/t0(0) o37->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 448/440 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.350857:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1814740 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+213:11754:x1798520455783680:12345-192.168.204.8@tcp:37:dbench.0 Request processed in 1773us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.350865:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 532 00000100:00100000:2.0:1715205776.352608:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.352759:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455783808 00000100:00100000:2.0:1715205776.352786:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1973 00000100:00100000:2.0:1715205776.352789:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+213:11754:x1798520455783808:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.352801:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.352814:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007cc3 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23a54 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.352879:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af4305007cca lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.352889:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb58d80/0xb608af4305006817 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232b3 expref: 214 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.352895:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af4305007cca lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.352922:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb58d80/0xb608af4305006817 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232b3 expref: 214 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.352931:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb58d80/0xb608af4305006817 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232b3 expref: 214 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.352941:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009edb1c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456036736:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.352974:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b310c0 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.353983:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.353988:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009edb1c80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456036736:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.354002:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af4305007cca lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.355131:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455783872 00010000:00010000:1.0:1715205776.355149:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb58d80/0xb608af4305006817 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232b3 expref: 215 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.355175:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4790 00000100:00100000:1.0:1715205776.355178:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1816880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+215:1831:x1798520455783872:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1715205776.355186:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.355189:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb58d80/0xb608af4305006817 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232b3 expref: 215 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.355195:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb58d80/0xb608af4305006817 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232b3 expref: 215 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.355207:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb58d80/0xb608af4305006817 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232b3 expref: 215 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.355216:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee0:0x0].0x0 (ffff88012d4a6d00) 00010000:00010000:1.0:1715205776.355218:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af4305007cca lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.355224:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af4305007cca lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.355228:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af4305007cca lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.355243:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205776.355261:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af4305007cca lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.355269:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af4305007cca lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.355271:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1816880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+214:1831:x1798520455783872:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 93us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.355276:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4790 00000004:00200000:3.0:1715205776.355283:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee0:0x0]: returning size 260096 00010000:00010000:3.0:1715205776.355386:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007cc3 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a54 expref: 215 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.355401:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af4305007cca lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a54 expref: 214 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.355406:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee0:0x0].0x0 (ffff88012d4a6d00) 00010000:00010000:3.0:1715205776.355408:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1715205776.355409:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fada640, rc 0) 00010000:00000080:3.0:1715205776.355412:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb17c0 x1798520455783808/t330712482690(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.355442:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+214:11754:x1798520455783808:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2652us (2837us total) trans 330712482690 rc 0/0 00000100:00100000:3.0:1715205776.355449:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1973 00000100:00100000:2.0:1715205776.357338:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.357385:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455783936 00000100:00100000:3.0:1715205776.357413:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1974 00000100:00100000:3.0:1715205776.357416:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+214:11754:x1798520455783936:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.357428:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.357436:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305007cd8 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23a5b expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.357466:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af4305007cdf lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.357475:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af4305007cca lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a54 expref: 215 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.357480:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af4305007cdf lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.357504:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af4305007cca lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a54 expref: 215 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.357512:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af4305007cca lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a54 expref: 215 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.357521:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6deaac0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456036800:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.357558:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a6ea0c00 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.359278:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.359288:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6deaac0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456036800:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.359295:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455784000 00010000:00010000:3.0:1715205776.359301:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af4305007cdf lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.359308:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af4305007cca lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a54 expref: 216 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.359324:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4791 00000100:00100000:1.0:1715205776.359327:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1815a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+216:1831:x1798520455784000:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1715205776.359333:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.359336:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af4305007cca lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a54 expref: 216 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.359343:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af4305007cca lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a54 expref: 216 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.359355:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af4305007cca lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a54 expref: 216 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.359363:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee0:0x0].0x0 (ffff88012d4a6d00) 00010000:00010000:1.0:1715205776.359365:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af4305007cdf lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.359370:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af4305007cdf lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.359374:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af4305007cdf lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.359393:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205776.359395:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af4305007cdf lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.359399:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af4305007cdf lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.359411:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1815a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+215:1831:x1798520455784000:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 83us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.359416:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4791 00000004:00200000:3.0:1715205776.359421:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee0:0x0]: returning size 260096 00000004:00200000:3.0:1715205776.359424:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205776.359434:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af4305007cdf lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.359442:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af4305007cdf lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.359456:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af4305007cd8 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a5b expref: 215 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.359472:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af4305007cdf lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a5b expref: 214 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.359476:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee0:0x0].0x0 (ffff88012d4a6d00) 00010000:00010000:3.0:1715205776.359479:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205776.359480:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ac6c0, rc 0) 00010000:00000080:3.0:1715205776.359483:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb1c80 x1798520455783936/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.359501:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+214:11754:x1798520455783936:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2083us (2164us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.359506:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1974 00000100:00100000:0.0:1715205776.361078:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.361355:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455784064 00000100:00100000:3.0:1715205776.361377:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1975 00000100:00100000:3.0:1715205776.361381:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1812f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+214:11754:x1798520455784064:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.361390:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.361398:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305007ce6 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23a62 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.361424:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305007ced lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.361431:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305007ced lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.361438:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305007ced lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.361450:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007cf4 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.361455:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007cf4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.361459:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007cf4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.361507:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305007ced lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.361512:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305007ced lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.361516:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305007ced lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.361521:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73add40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205776.361523:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305007ced lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.361529:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305007ced lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.361535:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205776.361537:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205776.361539:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305007ced lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.361547:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305007ced lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.361554:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007cf4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.361558:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007cf4 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.361563:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007cf4 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.361566:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ad440 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205776.361568:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007cf4 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.361572:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007cf4 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.361576:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x52a89496 (ffff88012cbdcf00) 00010000:00010000:3.0:1715205776.361578:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205776.361579:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007cf4 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.361582:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af4305007cf4 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.361606:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305007ce6 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a62 expref: 215 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.361651:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305007ce6 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a62 expref: 215 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.361660:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ac900, rc 0) 00010000:00000080:3.0:1715205776.361663:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1812f80 x1798520455784064/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.361694:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1812f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+214:11754:x1798520455784064:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 312us (617us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205776.361699:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1975 00000100:00100000:1.0:1715205776.362659:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.362719:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455784192 00000100:00100000:2.0:1715205776.362758:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 533 00000100:00100000:2.0:1715205776.362762:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372ff6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+214:11754:x1798520455784192:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.362884:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801372ff6c0 x1798520455784192/t330712482691(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.362915:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372ff6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+215:11754:x1798520455784192:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 153us (258us total) trans 330712482691 rc 0/0 00000100:00100000:2.0:1715205776.362923:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 533 00000100:00100000:1.0:1715205776.363786:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.363854:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455784320 00000100:00100000:2.0:1715205776.363874:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1976 00000100:00100000:2.0:1715205776.363877:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372fed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+215:11754:x1798520455784320:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.363888:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.363896:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007cfb lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23a69 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.363942:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007d02 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.363952:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af4305007cdf lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a5b expref: 216 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.363957:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007d02 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.363978:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af4305007cdf lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a5b expref: 216 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.363986:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af4305007cdf lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a5b expref: 216 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.363995:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009edb3440 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456036864:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.364035:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b316c0 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.364919:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.364919:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009edb3440 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456036864:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.364932:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007d02 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.364942:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455784384 00010000:00010000:0.0:1715205776.364956:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af4305007cdf lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a5b expref: 217 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.364973:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4792 00000100:00100000:0.0:1715205776.364976:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+217:1830:x1798520455784384:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1715205776.364983:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.364987:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af4305007cdf lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a5b expref: 217 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.364994:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af4305007cdf lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a5b expref: 217 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.365004:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af4305007cdf lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a5b expref: 217 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.365015:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee0:0x0].0x0 (ffff88012d4a6d00) 00010000:00010000:0.0:1715205776.365018:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007d02 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.365024:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007d02 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.365029:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007d02 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.365062:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205776.365074:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007d02 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.365080:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007d02 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.365090:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+216:1830:x1798520455784384:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 113us (172us total) trans 0 rc 0/0 00000004:00200000:3.0:1715205776.365091:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee0:0x0]: returning size 260096 00000100:00100000:0.0:1715205776.365095:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4792 00010000:00010000:3.0:1715205776.365159:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007cfb lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a69 expref: 217 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.365169:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007d02 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a69 expref: 216 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.365178:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee0:0x0].0x0 (ffff88012d4a6d00) 00010000:00010000:3.0:1715205776.365179:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1715205776.365181:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fadb180, rc 0) 00010000:00000080:3.0:1715205776.365185:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801372fed40 x1798520455784320/t330712482692(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.365208:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372fed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+216:11754:x1798520455784320:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1330us (1424us total) trans 330712482692 rc 0/0 00000100:00100000:3.0:1715205776.365213:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1976 00000100:00100000:2.0:1715205776.366003:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.366043:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455784448 00000100:00100000:3.0:1715205776.366072:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1977 00000100:00100000:3.0:1715205776.366076:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+216:11754:x1798520455784448:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.366086:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.366093:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305007d10 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23a70 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.366117:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305007d17 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.366125:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007d02 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a69 expref: 217 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.366130:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305007d17 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.366144:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007d02 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a69 expref: 217 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.366155:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007d02 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a69 expref: 217 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.366162:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6deaac0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456036928:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.366194:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a6ea0000 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.366874:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6deaac0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456036928:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.366885:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305007d17 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.366933:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.366979:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455784512 00010000:00010000:0.0:1715205776.367007:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007d02 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a69 expref: 218 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.367036:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4793 00000100:00100000:0.0:1715205776.367041:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129eba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+218:1831:x1798520455784512:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1715205776.367054:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.367058:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007d02 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a69 expref: 218 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.367066:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007d02 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a69 expref: 218 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.367083:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007d02 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a69 expref: 218 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.367096:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee0:0x0].0x0 (ffff88012d4a6d00) 00010000:00010000:0.0:1715205776.367099:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305007d17 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.367106:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305007d17 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.367112:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305007d17 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.367137:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205776.367148:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305007d17 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.367154:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305007d17 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205776.367172:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee0:0x0]: returning size 260096 00000004:00200000:3.0:1715205776.367174:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:0.0:1715205776.367179:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129eba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+217:1831:x1798520455784512:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 138us (246us total) trans 0 rc 0/0 00000004:00010000:3.0:1715205776.367181:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305007d17 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.367185:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4793 00010000:00010000:3.0:1715205776.367186:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305007d17 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.367197:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305007d10 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a70 expref: 217 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.367205:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305007d17 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a70 expref: 216 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.367209:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee0:0x0].0x0 (ffff88012d4a6d00) 00010000:00010000:3.0:1715205776.367210:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205776.367211:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73af600, rc 0) 00010000:00000080:3.0:1715205776.367213:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb6d40 x1798520455784448/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.367232:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+216:11754:x1798520455784448:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1156us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.367237:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1977 00000100:00100000:1.0:1715205776.368471:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.368537:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455784640 00000100:00100000:3.0:1715205776.368562:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1978 00000100:00100000:3.0:1715205776.368566:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372fd580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+216:11754:x1798520455784640:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.368576:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.368584:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305007d1e lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23a77 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.368680:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305007d25 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.368690:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ad00/0xb608af430500683a lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232c1 expref: 217 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.368695:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305007d25 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.368712:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ad00/0xb608af430500683a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232c1 expref: 217 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.368725:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ad00/0xb608af430500683a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232c1 expref: 217 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.368745:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6deaac0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456036992:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.368778:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a6ea0000 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.369612:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6deaac0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456036992:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.369640:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305007d25 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.369919:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.369970:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455784704 00010000:00010000:0.0:1715205776.369987:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ad00/0xb608af430500683a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232c1 expref: 218 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.370011:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4794 00000100:00100000:0.0:1715205776.370015:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372fa600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+218:1831:x1798520455784704:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1715205776.370022:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.370025:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ad00/0xb608af430500683a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232c1 expref: 218 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.370033:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ad00/0xb608af430500683a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232c1 expref: 218 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.370045:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5ad00/0xb608af430500683a lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232c1 expref: 218 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.370054:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee1:0x0].0x0 (ffff880099676100) 00010000:00010000:0.0:1715205776.370056:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305007d25 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.370062:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305007d25 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.370067:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305007d25 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.370090:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205776.370105:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305007d25 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.370112:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305007d25 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.370116:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372fa600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+217:1831:x1798520455784704:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 100us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.370121:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4794 00000004:00200000:3.0:1715205776.370123:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee1:0x0]: returning size 260096 00010000:00010000:3.0:1715205776.370211:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305007d1e lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a77 expref: 218 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.370220:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305007d25 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a77 expref: 217 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.370225:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee1:0x0].0x0 (ffff880099676100) 00010000:00010000:3.0:1715205776.370227:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1715205776.370228:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73af3c0, rc 0) 00010000:00000080:3.0:1715205776.370231:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801372fd580 x1798520455784640/t330712482693(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.370268:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372fd580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+217:11754:x1798520455784640:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1701us (1799us total) trans 330712482693 rc 0/0 00000100:00100000:3.0:1715205776.370276:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1978 00000100:00100000:2.0:1715205776.371055:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.371086:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455784768 00000100:00100000:3.0:1715205776.371110:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1979 00000100:00100000:3.0:1715205776.371114:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+217:11754:x1798520455784768:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.371125:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.371132:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007d33 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23a7e expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.371166:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007d3a lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.371173:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305007d25 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a77 expref: 218 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.371178:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007d3a lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.371193:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305007d25 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a77 expref: 218 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.371200:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305007d25 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a77 expref: 218 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.371207:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6deaac0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037056:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.371245:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a6ea0000 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.372646:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6deaac0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037056:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.372658:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007d3a lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.372682:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.372728:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455784832 00010000:00010000:0.0:1715205776.372754:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305007d25 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a77 expref: 219 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.372785:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4795 00000100:00100000:0.0:1715205776.372788:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372faac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+219:1830:x1798520455784832:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205776.372794:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.372797:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305007d25 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a77 expref: 219 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.372802:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305007d25 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a77 expref: 219 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.372811:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305007d25 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a77 expref: 219 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.372818:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee1:0x0].0x0 (ffff880099676100) 00010000:00010000:0.0:1715205776.372820:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007d3a lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.372824:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007d3a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.372827:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007d3a lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.372848:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.372865:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372faac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+218:1830:x1798520455784832:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 76us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.372870:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4795 00010000:00010000:2.0:1715205776.372940:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007d3a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.372948:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007d3a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.372982:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee1:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.372984:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.372997:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007d3a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.373004:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007d3a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.373023:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007d33 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a7e expref: 218 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.373051:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007d3a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a7e expref: 217 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.373056:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee1:0x0].0x0 (ffff880099676100) 00010000:00010000:2.0:1715205776.373058:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.373059:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73afa80, rc 0) 00010000:00000080:2.0:1715205776.373063:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb63c0 x1798520455784768/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.373102:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+217:11754:x1798520455784768:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1987us (2048us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.373107:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1979 00000100:00100000:1.0:1715205776.374154:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.374323:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455784960 00000100:00100000:2.0:1715205776.374353:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1980 00000100:00100000:2.0:1715205776.374357:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372f9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+217:11754:x1798520455784960:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.374368:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.374376:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af4305007d41 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23a85 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.374428:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007d48 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.374437:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a640/0xb608af430500685d lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232cf expref: 218 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.374443:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007d48 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.374460:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a640/0xb608af430500685d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232cf expref: 218 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.374467:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a640/0xb608af430500685d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232cf expref: 218 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.374475:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009edb4c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037120:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.374513:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.375609:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009edb4c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037120:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.375648:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007d48 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.375747:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.375813:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455785024 00010000:00010000:3.0:1715205776.375827:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a640/0xb608af430500685d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232cf expref: 219 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.375854:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4796 00000100:00100000:3.0:1715205776.375858:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372fe880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+219:1831:x1798520455785024:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1715205776.375866:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.375869:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a640/0xb608af430500685d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232cf expref: 219 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.375876:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a640/0xb608af430500685d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232cf expref: 219 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.375910:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5a640/0xb608af430500685d lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232cf expref: 219 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.375920:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee2:0x0].0x0 (ffff88012d4a6400) 00010000:00010000:3.0:1715205776.375923:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007d48 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.375929:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007d48 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.375934:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007d48 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.375957:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.376026:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007d48 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.376032:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007d48 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.376044:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee2:0x0]: returning size 260096 00000100:00100000:3.0:1715205776.376065:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372fe880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+218:1831:x1798520455785024:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 205us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.376071:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4796 00010000:00010000:2.0:1715205776.376138:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af4305007d41 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a85 expref: 219 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.376148:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007d48 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a85 expref: 218 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.376153:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee2:0x0].0x0 (ffff88012d4a6400) 00010000:00010000:2.0:1715205776.376155:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.376156:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fadb840, rc 0) 00010000:00000080:2.0:1715205776.376160:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801372f9300 x1798520455784960/t330712482694(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.376195:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372f9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+218:11754:x1798520455784960:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1837us (2042us total) trans 330712482694 rc 0/0 00000100:00100000:2.0:1715205776.376200:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1980 00000100:00100000:1.0:1715205776.377283:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.377326:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455785088 00000100:00100000:2.0:1715205776.377353:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1981 00000100:00100000:2.0:1715205776.377356:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372fcc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+218:11754:x1798520455785088:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.377367:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.377375:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305007d56 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23a8c expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.377406:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007d5d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.377415:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007d48 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a85 expref: 219 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.377420:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007d5d lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.377436:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007d48 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a85 expref: 219 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.377443:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007d48 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a85 expref: 219 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.377451:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009edb4c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037184:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.377488:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.378503:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.378516:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009edb4c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037184:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.378529:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007d5d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.378656:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455785152 00010000:00010000:3.0:1715205776.378671:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007d48 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a85 expref: 220 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.378688:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4797 00000100:00100000:3.0:1715205776.378692:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a18163c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:1830:x1798520455785152:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1715205776.378698:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.378708:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007d48 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a85 expref: 220 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.378716:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007d48 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a85 expref: 220 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.378731:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007d48 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a85 expref: 220 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.378757:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee2:0x0].0x0 (ffff88012d4a6400) 00010000:00010000:3.0:1715205776.378759:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007d5d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.378765:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007d5d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.378774:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007d5d lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.378799:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.378821:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007d5d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.378828:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007d5d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.378828:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a18163c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+219:1830:x1798520455785152:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 135us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.378833:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4797 00000004:00200000:2.0:1715205776.378853:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee2:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.378856:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.378867:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007d5d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.378874:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007d5d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.378889:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305007d56 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a8c expref: 219 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.378898:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007d5d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a8c expref: 218 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.378903:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee2:0x0].0x0 (ffff88012d4a6400) 00010000:00010000:2.0:1715205776.378904:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.378906:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fad9200, rc 0) 00010000:00000080:2.0:1715205776.378909:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801372fcc00 x1798520455785088/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.378938:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372fcc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+218:11754:x1798520455785088:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1581us (1658us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.378944:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1981 00000100:00100000:0.0:1715205776.380983:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.381047:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455785280 00000100:00100000:2.0:1715205776.381086:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1982 00000100:00100000:2.0:1715205776.381090:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1816880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+218:11754:x1798520455785280:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.381102:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.381114:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af4305007d64 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23a93 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.381170:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007d6b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.381180:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59440/0xb608af4305006880 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232dd expref: 219 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.381186:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007d6b lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.381208:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59440/0xb608af4305006880 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232dd expref: 219 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.381216:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59440/0xb608af4305006880 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232dd expref: 219 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.381225:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009edb4c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037248:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.381275:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.383042:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009edb4c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037248:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.383057:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:2.0:1715205776.383061:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007d6b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.383238:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455785344 00010000:00010000:3.0:1715205776.383256:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59440/0xb608af4305006880 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232dd expref: 220 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.383284:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4798 00000100:00100000:3.0:1715205776.383288:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372ff200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:1831:x1798520455785344:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205776.383296:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.383300:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59440/0xb608af4305006880 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232dd expref: 220 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.383307:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59440/0xb608af4305006880 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232dd expref: 220 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.383320:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59440/0xb608af4305006880 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b232dd expref: 220 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.383332:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee3:0x0].0x0 (ffff88009399ee00) 00010000:00010000:3.0:1715205776.383335:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007d6b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.383344:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007d6b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.383349:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007d6b lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.383370:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205776.383402:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372ff200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+219:1831:x1798520455785344:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 113us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.383406:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4798 00010000:00010000:2.0:1715205776.383464:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007d6b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.383470:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007d6b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.383484:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee3:0x0]: returning size 260096 00010000:00010000:2.0:1715205776.383584:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af4305007d64 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a93 expref: 220 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.383598:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007d6b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a93 expref: 219 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.383603:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee3:0x0].0x0 (ffff88009399ee00) 00010000:00010000:2.0:1715205776.383605:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.383607:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fad8b40, rc 0) 00010000:00000080:2.0:1715205776.383610:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1816880 x1798520455785280/t330712482695(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.383668:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1816880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+219:11754:x1798520455785280:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2577us (2691us total) trans 330712482695 rc 0/0 00000100:00100000:2.0:1715205776.383674:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1982 00000100:00100000:1.0:1715205776.384918:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.384990:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455785408 00000100:00100000:2.0:1715205776.385022:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1983 00000100:00100000:2.0:1715205776.385026:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372fa140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+219:11754:x1798520455785408:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.385040:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.385050:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af4305007d79 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23a9a expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.385083:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af4305007d80 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.385092:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007d6b lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a93 expref: 220 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.385098:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af4305007d80 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.385121:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007d6b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a93 expref: 220 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.385130:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007d6b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a93 expref: 220 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.385139:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009edb4c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037312:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.385182:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.386022:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009edb4c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037312:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.386046:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af4305007d80 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.386480:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.386648:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455785472 00010000:00010000:3.0:1715205776.386666:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007d6b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a93 expref: 221 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.386692:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4799 00000100:00100000:3.0:1715205776.386714:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372faf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+221:1830:x1798520455785472:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1715205776.386723:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.386727:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007d6b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a93 expref: 221 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.386745:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007d6b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a93 expref: 221 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.386758:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af4305007d6b lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a93 expref: 221 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.386769:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee3:0x0].0x0 (ffff88009399ee00) 00010000:00010000:3.0:1715205776.386772:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af4305007d80 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.386778:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af4305007d80 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.386783:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af4305007d80 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.386808:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205776.386838:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372faf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:1830:x1798520455785472:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 141us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.386844:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4799 00010000:00010000:2.0:1715205776.386848:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af4305007d80 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.386856:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af4305007d80 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.386895:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee3:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.386899:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.386914:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af4305007d80 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.386924:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af4305007d80 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.386944:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af4305007d79 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a9a expref: 220 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.386961:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af4305007d80 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a9a expref: 219 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.386968:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee3:0x0].0x0 (ffff88009399ee00) 00010000:00010000:2.0:1715205776.386970:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.386972:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fad98c0, rc 0) 00010000:00000080:2.0:1715205776.386977:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801372fa140 x1798520455785408/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.387013:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372fa140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+219:11754:x1798520455785408:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1986us (2097us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.387020:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1983 00000100:00100000:1.0:1715205776.388894:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.388963:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455785600 00000100:00100000:2.0:1715205776.389005:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1984 00000100:00100000:2.0:1715205776.389010:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+219:11754:x1798520455785600:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.389046:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.389060:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8480/0xb608af4305007d87 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23aa1 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.389129:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af4305007d8e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.389142:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca1c0/0xb608af4305006d57 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23496 expref: 220 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.389148:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af4305007d8e lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.389179:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca1c0/0xb608af4305006d57 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23496 expref: 220 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.389189:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca1c0/0xb608af4305006d57 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23496 expref: 220 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.389201:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009edb4c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037376:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.389372:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.390258:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009edb4c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037376:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.390273:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af4305007d8e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.391174:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.391263:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455785664 00010000:00010000:3.0:1715205776.391285:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca1c0/0xb608af4305006d57 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23496 expref: 221 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.391321:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4800 00000100:00100000:3.0:1715205776.391325:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+221:1831:x1798520455785664:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1715205776.391337:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.391341:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca1c0/0xb608af4305006d57 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23496 expref: 221 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.391349:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca1c0/0xb608af4305006d57 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23496 expref: 221 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.391365:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca1c0/0xb608af4305006d57 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23496 expref: 221 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.391381:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100c:0x0].0x0 (ffff88012d4a6900) 00010000:00010000:3.0:1715205776.391384:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af4305007d8e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.391390:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af4305007d8e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.391396:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af4305007d8e lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.391426:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205776.391461:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:1831:x1798520455785664:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 135us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.391468:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4800 00010000:00010000:2.0:1715205776.391485:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af4305007d8e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.391496:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af4305007d8e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.391687:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x100c:0x0]: returning size 543 00010000:00010000:2.0:1715205776.391822:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8480/0xb608af4305007d87 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aa1 expref: 221 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.391836:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af4305007d8e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aa1 expref: 220 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.391842:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100c:0x0].0x0 (ffff88012d4a6900) 00010000:00010000:2.0:1715205776.391844:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.391846:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fadad00, rc 0) 00010000:00000080:2.0:1715205776.391851:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce7b900 x1798520455785600/t330712482696(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.391896:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:11754:x1798520455785600:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2884us (3004us total) trans 330712482696 rc 0/0 00000100:00100000:2.0:1715205776.391903:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1984 00000100:00100000:1.0:1715205776.392968:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.393008:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455785728 00000100:00100000:2.0:1715205776.393039:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1985 00000100:00100000:2.0:1715205776.393044:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce7af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:11754:x1798520455785728:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.393058:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.393068:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af4305007d9c lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23aa8 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.393103:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007da3 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.393114:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af4305007d8e lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aa1 expref: 221 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.393119:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007da3 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.393141:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af4305007d8e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aa1 expref: 221 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.393150:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af4305007d8e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aa1 expref: 221 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.393160:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009edb4c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037440:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.393195:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.395353:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009edb4c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037440:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.395355:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:2.0:1715205776.395371:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007da3 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.395426:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455785792 00010000:00010000:3.0:1715205776.395463:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af4305007d8e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aa1 expref: 222 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.395496:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4801 00000100:00100000:3.0:1715205776.395500:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1815a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+222:1830:x1798520455785792:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1715205776.395511:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.395516:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af4305007d8e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aa1 expref: 222 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.395524:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af4305007d8e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aa1 expref: 222 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.395546:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af4305007d8e lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aa1 expref: 222 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.395558:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100c:0x0].0x0 (ffff88012d4a6900) 00010000:00010000:3.0:1715205776.395562:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007da3 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.395569:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007da3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.395574:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007da3 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.395605:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205776.395681:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1815a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+221:1830:x1798520455785792:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 179us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.395687:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4801 00010000:00010000:2.0:1715205776.395955:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007da3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.395966:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007da3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.395995:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x100c:0x0]: returning size 543 00000004:00200000:2.0:1715205776.395998:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.396010:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007da3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.396018:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007da3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.396036:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af4305007d9c lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aa8 expref: 221 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.396047:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007da3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aa8 expref: 220 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.396053:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100c:0x0].0x0 (ffff88012d4a6900) 00010000:00010000:2.0:1715205776.396056:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.396057:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fad8fc0, rc 0) 00010000:00000080:2.0:1715205776.396062:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009ce7af80 x1798520455785728/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.396107:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce7af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:11754:x1798520455785728:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 3062us (3140us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.396113:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1985 00000100:00100000:0.0:1715205776.397300:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.397342:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455785856 00000100:00100000:2.0:1715205776.397371:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1986 00000100:00100000:2.0:1715205776.397375:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a18163c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:11754:x1798520455785856:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.397385:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.397394:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af4305007daa lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23aaf expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.397424:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305007db1 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.397432:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305007db1 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.397439:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305007db1 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.397449:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007db8 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.397453:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007db8 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.397458:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007db8 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.397508:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305007db1 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.397513:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305007db1 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.397518:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305007db1 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.397522:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009fad86c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.397524:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305007db1 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.397529:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305007db1 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.397535:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.397537:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.397539:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305007db1 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.397543:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305007db1 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.397550:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007db8 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.397554:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007db8 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.397562:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007db8 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.397566:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009fadb840 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.397567:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007db8 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.397571:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007db8 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.397576:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x6c9b575e (ffff880092bfc000) 00010000:00010000:2.0:1715205776.397578:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.397579:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007db8 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.397582:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305007db8 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.397607:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af4305007daa lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aaf expref: 221 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.397612:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af4305007daa lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aaf expref: 221 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.397699:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fada1c0, rc 0) 00010000:00000080:2.0:1715205776.397703:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a18163c0 x1798520455785856/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.397770:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a18163c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:11754:x1798520455785856:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 394us (472us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205776.397776:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1986 00000100:00100000:0.0:1715205776.399056:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.399189:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455785920 00000100:00100000:2.0:1715205776.399248:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1987 00000100:00100000:2.0:1715205776.399253:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2276c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:11754:x1798520455785920:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.399261:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.399269:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af4305007dbf lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23ab6 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.399293:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007dc6 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.399302:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007dc6 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.399308:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007dc6 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.399316:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007dcd lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.399320:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007dcd lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.399324:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007dcd lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.399355:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007dc6 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.399363:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007dc6 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.399368:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007dc6 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.399371:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009fadb180 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.399373:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007dc6 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.399377:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007dc6 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.399383:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.399385:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.399386:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007dc6 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.399390:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305007dc6 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.399397:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007dcd lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.399401:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007dcd lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.399404:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007dcd lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.399411:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009fada400 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.399413:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007dcd lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.399416:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007dcd lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.399420:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x6ce85660 (ffff880092bfc200) 00010000:00010000:2.0:1715205776.399421:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.399422:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007dcd lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.399425:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305007dcd lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.399447:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af4305007dbf lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ab6 expref: 221 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.399452:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af4305007dbf lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ab6 expref: 221 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.399458:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fadaac0, rc 0) 00010000:00000080:2.0:1715205776.399461:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012c2276c0 x1798520455785920/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.399501:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2276c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:11754:x1798520455785920:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 248us (447us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205776.399507:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1987 00000100:00100000:1.0:1715205776.400700:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.400762:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455786048 00000100:00100000:2.0:1715205776.400790:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1988 00000100:00100000:2.0:1715205776.400794:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:11754:x1798520455786048:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.400802:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.400810:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af4305007dd4 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23abd expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.400862:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007ddb lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.400870:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007ddb lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.400877:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007ddb lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.400884:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af4305007de2 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.400889:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af4305007de2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.400893:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af4305007de2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.400916:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007ddb lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.400920:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007ddb lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.400929:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007ddb lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.400932:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009fad8240 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.400934:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007ddb lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.400939:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007ddb lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.400945:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.400947:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.400948:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007ddb lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.400952:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305007ddb lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.400960:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af4305007de2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.400964:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af4305007de2 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.400967:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af4305007de2 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.400970:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009fadb600 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.400972:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af4305007de2 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.400976:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af4305007de2 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.400981:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x6ce85660 (ffff880092bfc100) 00010000:00010000:2.0:1715205776.400982:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.400983:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af4305007de2 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.400987:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af4305007de2 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.401003:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af4305007dd4 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23abd expref: 221 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.401008:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af4305007dd4 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23abd expref: 221 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.401013:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fada640, rc 0) 00010000:00000080:2.0:1715205776.401016:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880137119c80 x1798520455786048/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 656/600 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.401049:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880137119c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:11754:x1798520455786048:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 254us (351us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205776.401054:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1988 00000100:00100000:0.0:1715205776.402135:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.402197:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455786112 00000100:00100000:2.0:1715205776.402237:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1989 00000100:00100000:2.0:1715205776.402242:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:11754:x1798520455786112:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.402258:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.402270:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af4305007de9 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23ac4 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.402310:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305007df0 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.402320:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305007df0 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.402329:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305007df0 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.402341:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af4305007df7 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.402346:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af4305007df7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.402351:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af4305007df7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.402406:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305007df0 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.402411:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305007df0 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.402414:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305007df0 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.402420:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009fad8d80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.402423:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305007df0 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.402426:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305007df0 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.402432:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.402433:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.402435:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305007df0 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.402437:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305007df0 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.402446:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af4305007df7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.402450:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af4305007df7 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.402454:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af4305007df7 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.402459:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009fadaf40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.402460:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af4305007df7 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.402465:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af4305007df7 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.402471:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x6c9b575e (ffff880092bfc600) 00010000:00010000:2.0:1715205776.402473:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.402474:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af4305007df7 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.402478:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af4305007df7 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.402510:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af4305007de9 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ac4 expref: 221 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.402517:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af4305007de9 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ac4 expref: 221 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.402522:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fadb3c0, rc 0) 00010000:00000080:2.0:1715205776.402525:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147af80 x1798520455786112/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.402569:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:11754:x1798520455786112:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 328us (439us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205776.402573:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1989 00000100:00100000:2.0:1715205776.403903:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.403930:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455786240 00000100:00100000:0.0:1715205776.403971:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1990 00000100:00100000:0.0:1715205776.403976:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb4c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:11754:x1798520455786240:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.403989:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.404001:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af4305007dfe lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23acb expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.404066:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305007e05 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.404084:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305007e05 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.404092:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305007e05 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.404102:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305007e0c lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.404108:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305007e0c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.404112:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305007e0c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.404198:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305007e05 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.404204:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305007e05 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.404209:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305007e05 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.404213:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83e880 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.404216:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305007e05 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.404221:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305007e05 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.404229:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.404231:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.404233:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305007e05 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.404237:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305007e05 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.404257:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305007e0c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.404261:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305007e0c lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.404269:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305007e0c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.404272:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83db00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.404274:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305007e0c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.404277:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305007e0c lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.404281:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x6c9b575e (ffff8800940a3c00) 00010000:00010000:0.0:1715205776.404282:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.404283:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305007e0c lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.404286:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305007e0c lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.404306:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af4305007dfe lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23acb expref: 221 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.404312:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af4305007dfe lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23acb expref: 221 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.404318:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83df80, rc 0) 00010000:00000080:0.0:1715205776.404321:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb4c00 x1798520455786240/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 656/600 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.404376:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb4c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:11754:x1798520455786240:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 400us (476us total) trans 0 rc 301/301 00000100:00100000:0.0:1715205776.404382:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1990 00000100:00100000:1.0:1715205776.405613:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.405692:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455786304 00000100:00100000:0.0:1715205776.405728:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1991 00000100:00100000:0.0:1715205776.405744:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:11754:x1798520455786304:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.405753:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.405760:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af4305007e13 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23ad2 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.405787:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af4305007e1a lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.405795:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af4305007e1a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.405802:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af4305007e1a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.405810:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e640/0xb608af4305007e21 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.405815:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e640/0xb608af4305007e21 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.405820:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e640/0xb608af4305007e21 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.405850:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af4305007e1a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.405859:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af4305007e1a lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.405864:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af4305007e1a lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.405868:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83f180 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.405870:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af4305007e1a lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.405875:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af4305007e1a lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.405882:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.405884:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.405885:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af4305007e1a lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.405890:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af4305007e1a lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.406205:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e640/0xb608af4305007e21 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.406209:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e640/0xb608af4305007e21 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.406213:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e640/0xb608af4305007e21 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.406221:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83e640 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.406223:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e640/0xb608af4305007e21 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.406227:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e640/0xb608af4305007e21 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.406233:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x6ce85660 (ffff8800940a3f00) 00010000:00010000:0.0:1715205776.406234:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.406235:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e640/0xb608af4305007e21 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.406239:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e640/0xb608af4305007e21 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.406270:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af4305007e13 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ad2 expref: 221 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.406275:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af4305007e13 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ad2 expref: 221 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.406281:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83d680, rc 0) 00010000:00000080:0.0:1715205776.406285:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013711e3c0 x1798520455786304/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.406326:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:11754:x1798520455786304:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 592us (716us total) trans 0 rc 301/301 00000100:00100000:0.0:1715205776.406332:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1991 00000100:00100000:2.0:1715205776.408541:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.408595:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455786432 00000100:00100000:0.0:1715205776.408642:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1992 00000100:00100000:0.0:1715205776.408647:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:11754:x1798520455786432:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.408658:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.408668:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af4305007e28 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23ad9 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.408729:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af4305007e2f lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.408762:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af4305007e2f lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.408769:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af4305007e2f lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.408777:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007e36 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.408782:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007e36 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.408786:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007e36 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.408813:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af4305007e2f lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.408818:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af4305007e2f lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.408826:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af4305007e2f lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.408830:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83c900 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.408832:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af4305007e2f lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.408837:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af4305007e2f lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.408844:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.408846:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.408847:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af4305007e2f lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.408852:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af4305007e2f lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.408859:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007e36 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.408863:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007e36 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.408867:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007e36 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.408870:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83f3c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.408871:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007e36 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.408876:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007e36 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.408880:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x6ce85660 (ffff8800940a3b00) 00010000:00010000:0.0:1715205776.408882:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.408883:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007e36 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.408887:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007e36 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.408904:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af4305007e28 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ad9 expref: 221 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.408910:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af4305007e28 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ad9 expref: 221 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.408916:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83d200, rc 0) 00010000:00000080:0.0:1715205776.408920:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb5f00 x1798520455786432/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 656/600 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.408962:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:11754:x1798520455786432:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 315us (422us total) trans 0 rc 301/301 00000100:00100000:0.0:1715205776.408968:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1992 00000100:00100000:2.0:1715205776.410048:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.410064:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455786496 00000100:00100000:0.0:1715205776.410078:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1993 00000100:00100000:0.0:1715205776.410080:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:11754:x1798520455786496:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.410088:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.410092:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af4305007e3d lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23ae0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.410109:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305007e44 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.410114:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305007e44 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.410119:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305007e44 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.410127:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007e4b lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.410133:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007e4b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.410137:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007e4b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.410164:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305007e44 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.410168:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305007e44 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.410170:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305007e44 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.410175:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83fa80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.410177:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305007e44 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.410179:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305007e44 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.410183:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.410184:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.410185:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305007e44 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.410187:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305007e44 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.410192:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007e4b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.410195:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007e4b lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.410197:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007e4b lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.410199:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83cfc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.410200:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007e4b lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.410202:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007e4b lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.410205:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x6c9b575e (ffff8800940a3400) 00010000:00010000:0.0:1715205776.410206:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.410207:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007e4b lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.410209:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007e4b lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.410225:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af4305007e3d lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ae0 expref: 221 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.410229:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af4305007e3d lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ae0 expref: 221 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.410232:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83fcc0, rc 0) 00010000:00000080:0.0:1715205776.410234:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb04c0 x1798520455786496/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.410258:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:11754:x1798520455786496:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 177us (212us total) trans 0 rc 301/301 00000100:00100000:0.0:1715205776.410262:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1993 00000100:00100000:1.0:1715205776.411686:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.411744:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455786624 00000100:00100000:0.0:1715205776.411787:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1994 00000100:00100000:0.0:1715205776.411792:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013711bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:11754:x1798520455786624:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.411807:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.411809:0:14860:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1715205776.411831:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e1c0/0xb608af4305007cbc lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a4d expref: 220 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.411847:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.411850:0:14860:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.411859:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305007e52 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23ae7 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.411962:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007e59 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.411972:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007e59 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.411979:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007e59 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.411988:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007e60 lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.411993:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007e60 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.411998:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007e60 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715205776.412364:0:14860:0:(osp_object.c:1645:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x100010000:0x15dc:0x0], index 1: 0 00010000:00010000:0.0:1715205776.412500:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305007e67 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.412506:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305007e67 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.412513:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305007e67 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.412534:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007e59 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.412537:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007e59 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.412540:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007e59 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.412544:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83c480 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.412546:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007e59 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.412549:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007e59 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.412553:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.412554:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.412555:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007e59 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.412558:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007e59 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715205776.412564:0:14860:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88013711bdc0 reply state ffff8800a1033000 transno 330712482697 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007e60 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.412580:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305007e52 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ae7 expref: 222 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.412587:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305007e67 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ae7 expref: 221 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.412591:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1016:0x0].0x0 (ffff8800b7b20f00) 00010000:00010000:0.0:1715205776.412592:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1715205776.412593:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83d440, rc 0) 00010000:00000080:0.0:1715205776.412597:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013711bdc0 x1798520455786624/t330712482697(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 656/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.412678:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013711bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+222:11754:x1798520455786624:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 885us (996us total) trans 330712482697 rc 0/0 00000100:00100000:0.0:1715205776.412684:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1994 00010000:00010000:1.0:1715205776.413597:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007e60 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.413605:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007e60 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.413615:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007e60 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.413646:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83f840 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.413648:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007e60 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.413653:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007e60 lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.413661:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x6c9b575e (ffff8800a5e7a600) 00010000:00010000:1.0:1715205776.413663:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.413664:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007e60 lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.413669:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007e60 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.413917:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.413941:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455786688 00000100:00100000:1.0:1715205776.413965:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1995 00000100:00100000:1.0:1715205776.413970:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+221:11754:x1798520455786688:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.413983:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.413991:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af4305007e75 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23aee expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.414021:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305007e7c lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.414032:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305007e7c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.414039:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305007e7c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205776.414057:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205776.414065:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305007e7c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.414072:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305007e7c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.414084:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af4305007e75 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aee expref: 223 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.414093:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305007e7c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aee expref: 222 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.414098:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1016:0x0].0x0 (ffff8800b7b20f00) 00010000:00010000:1.0:1715205776.414100:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205776.414101:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9b840, rc 0) 00010000:00000080:1.0:1715205776.414105:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb4280 x1798520455786688/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.414132:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+222:11754:x1798520455786688:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 162us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.414138:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1995 00000100:00100000:2.0:1715205776.416909:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.416941:0:20898:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455786752 00000100:00100000:2.0:1715205776.416971:0:20898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14697 00000100:00100000:2.0:1715205776.416977:0:20898:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb50c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+44:1831:x1798520455786752:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.416989:0:20898:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.417002:0:20898:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fadb3c0/0xb608af4305007e83 lrc: 2/0,0 mode: --/PR res: [0x15dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23af5 expref: -99 pid: 20898 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1715205776.417020:0:20898:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x15dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1715205776.417031:0:20898:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715205776.417033:0:20898:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715205776.417039:0:20898:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fadb3c0/0xb608af4305007e83 lrc: 3/0,0 mode: PR/PR res: [0x15dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23af5 expref: 45 pid: 20898 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715205776.417051:0:20898:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fadb3c0/0xb608af4305007e83 lrc: 3/0,0 mode: PR/PR res: [0x15dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23af5 expref: 45 pid: 20898 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1715205776.417060:0:20898:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fadb3c0, rc 0) 00000100:00100000:2.0:1715205776.417089:0:20898:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb50c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+45:1831:x1798520455786752:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 113us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.417095:0:20898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14697 00000100:00100000:2.0:1715205776.419284:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.419369:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455786880 00000100:00100000:3.0:1715205776.419399:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 534 00000100:00100000:3.0:1715205776.419404:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+222:11754:x1798520455786880:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:3.0:1715205776.419614:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb2600 x1798520455786880/t330712482698(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.419663:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+223:11754:x1798520455786880:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 259us (381us total) trans 330712482698 rc 0/0 00000100:00100000:3.0:1715205776.419669:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 534 00000100:00100000:1.0:1715205776.420955:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.420997:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455787008 00000100:00100000:0.0:1715205776.421020:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1996 00000100:00100000:0.0:1715205776.421024:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a49c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+223:11754:x1798520455787008:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.421036:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.421047:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305007e8a lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23afc expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.421100:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007e91 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.421110:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305007e7c lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aee expref: 224 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.421120:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007e91 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.421143:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305007e7c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aee expref: 224 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.421151:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305007e7c lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aee expref: 224 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.421160:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013147c740 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037504:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.421199:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b50f3c0 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.422168:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.422206:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013147c740 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037504:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.422214:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455787072 00010000:00010000:2.0:1715205776.422232:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305007e7c lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aee expref: 225 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.422233:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007e91 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.422263:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4802 00000100:00100000:2.0:1715205776.422267:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+225:1830:x1798520455787072:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1715205776.422275:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.422279:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305007e7c lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aee expref: 225 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.422288:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305007e7c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aee expref: 225 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.422301:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305007e7c lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aee expref: 225 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.422310:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1016:0x0].0x0 (ffff8800b7b20f00) 00010000:00010000:2.0:1715205776.422313:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007e91 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.422319:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007e91 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.422324:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007e91 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.422376:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205776.422408:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+224:1830:x1798520455787072:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 139us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.422414:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4802 00010000:00010000:1.0:1715205776.422463:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007e91 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.422471:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007e91 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205776.422484:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1016:0x0]: returning size 0 00010000:00010000:1.0:1715205776.422574:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305007e8a lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23afc expref: 225 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.422585:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007e91 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23afc expref: 224 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.422591:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1016:0x0].0x0 (ffff8800b7b20f00) 00010000:00010000:1.0:1715205776.422593:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205776.422594:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83cb40, rc 0) 00010000:00000080:1.0:1715205776.422597:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6a49c80 x1798520455787008/t330712482699(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.422648:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a49c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+224:11754:x1798520455787008:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1622us (1694us total) trans 330712482699 rc 0/0 00000100:00100000:1.0:1715205776.422654:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1996 00000100:00100000:1.0:1715205776.423799:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.423814:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455787136 00000100:00100000:1.0:1715205776.423844:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1997 00000100:00100000:1.0:1715205776.423848:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a4ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+224:11754:x1798520455787136:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.423859:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.423866:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af4305007e9f lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23b03 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.423896:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305007ea6 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.423904:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007e91 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23afc expref: 225 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.423909:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305007ea6 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.423932:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007e91 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23afc expref: 225 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.423940:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007e91 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23afc expref: 225 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.423949:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a61b2140 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037568:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.423974:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099530240 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.424731:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a61b2140 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037568:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.424758:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305007ea6 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.425077:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.425149:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455787200 00010000:00010000:2.0:1715205776.425176:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007e91 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23afc expref: 226 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.425212:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4803 00000100:00100000:2.0:1715205776.425217:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b2140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+226:1830:x1798520455787200:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1715205776.425228:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.425233:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007e91 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23afc expref: 226 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.425241:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007e91 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23afc expref: 226 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.425258:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007e91 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23afc expref: 226 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.425271:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1016:0x0].0x0 (ffff8800b7b20f00) 00010000:00010000:2.0:1715205776.425275:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305007ea6 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.425282:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305007ea6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.425287:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305007ea6 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.425306:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205776.425331:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305007ea6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.425336:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b2140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+225:1830:x1798520455787200:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 119us (262us total) trans 0 rc 0/0 00010000:00010000:1.0:1715205776.425338:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305007ea6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.425341:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4803 00000004:00200000:1.0:1715205776.425374:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1016:0x0]: returning size 0 00000004:00200000:1.0:1715205776.425377:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205776.425457:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305007ea6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.425464:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305007ea6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.425481:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af4305007e9f lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b03 expref: 225 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.425490:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305007ea6 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b03 expref: 224 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.425494:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1016:0x0].0x0 (ffff8800b7b20f00) 00010000:00010000:1.0:1715205776.425496:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205776.425497:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd98240, rc 0) 00010000:00000080:1.0:1715205776.425501:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6a4ed40 x1798520455787136/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.425531:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a4ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+224:11754:x1798520455787136:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1683us (1734us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.425536:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1997 00000100:00100000:1.0:1715205776.427169:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.427288:0:20898:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455787264 00000100:00100000:0.0:1715205776.427400:0:19961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14698 00000100:00100000:0.0:1715205776.427405:0:19961:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b7200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+45:11754:x1798520455787264:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.427420:0:19961:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.427435:0:19961:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c83c6c0/0xb608af4305007ead lrc: 2/0,0 mode: --/PW res: [0x15dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23b0a expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.427457:0:19961:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fadb3c0/0xb608af4305007e83 lrc: 2/0,0 mode: PR/PR res: [0x15dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23af5 expref: 46 pid: 20898 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1715205776.427464:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205776.427465:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205776.427468:0:19961:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c83c6c0/0xb608af4305007ead lrc: 4/0,0 mode: --/PW res: [0x15dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b0a expref: 46 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.427493:0:19961:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fadb3c0/0xb608af4305007e83 lrc: 3/0,0 mode: PR/PR res: [0x15dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23af5 expref: 46 pid: 20898 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1715205776.427507:0:19961:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fadb3c0/0xb608af4305007e83 lrc: 4/0,0 mode: PR/PR res: [0x15dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23af5 expref: 46 pid: 20898 timeout: 3136 lvb_type: 1 00000100:00100000:0.0:1715205776.427519:0:19961:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880131479300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:19961:1798520456037632:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.427633:0:19961:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b50f780 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.429235:0:19961:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880131479300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:19961:1798520456037632:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.429259:0:19961:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c83c6c0/0xb608af4305007ead lrc: 3/0,0 mode: --/PW res: [0x15dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b0a expref: 46 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.429276:0:19961:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83c6c0, rc 0) 00000100:00100000:0.0:1715205776.429603:0:19961:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b7200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+46:11754:x1798520455787264:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2195us (2435us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.429611:0:19961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14698 00000100:00100000:1.0:1715205776.430370:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.430417:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455787328 00010000:00010000:2.0:1715205776.430702:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fadb3c0/0xb608af4305007e83 lrc: 4/0,0 mode: PR/PR res: [0x15dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23af5 expref: 46 pid: 20898 timeout: 3136 lvb_type: 1 00000100:00100000:2.0:1715205776.430747:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4804 00000100:00100000:2.0:1715205776.430752:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b1c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+46:1830:x1798520455787328:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1715205776.430762:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.430778:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fadb3c0/0xb608af4305007e83 lrc: 4/0,0 mode: PR/PR res: [0x15dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23af5 expref: 46 pid: 20898 timeout: 3136 lvb_type: 1 00010000:00010000:2.0:1715205776.430787:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fadb3c0/0xb608af4305007e83 lrc: 3/0,0 mode: PR/PR res: [0x15dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23af5 expref: 46 pid: 20898 timeout: 3136 lvb_type: 1 00010000:00010000:2.0:1715205776.430805:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fadb3c0/0xb608af4305007e83 lrc: 0/0,0 mode: --/PR res: [0x15dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23af5 expref: 46 pid: 20898 timeout: 3136 lvb_type: 1 00010000:00010000:2.0:1715205776.430814:0:8315:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715205776.430815:0:8315:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715205776.430820:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c83c6c0/0xb608af4305007ead lrc: 2/0,0 mode: PW/PW res: [0x15dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b0a expref: 45 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.430827:0:8315:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c83c6c0/0xb608af4305007ead lrc: 3/0,0 mode: PW/PW res: [0x15dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b0a expref: 45 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.430849:0:8315:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c83c6c0/0xb608af4305007ead lrc: 3/0,0 mode: PW/PW res: [0x15dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b0a expref: 45 pid: 19961 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.430859:0:8315:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009edb1300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8315:1798520456037696:192.168.204.8@tcp:105: 00000100:00100000:2.0:1715205776.430903:0:8315:0:(client.c:2492:ptlrpc_set_wait()) set ffff880135b31300 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.431639:0:8315:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009edb1300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8315:1798520456037696:192.168.204.8@tcp:105: 00010000:00010000:2.0:1715205776.431654:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205776.431671:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b1c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+45:1830:x1798520455787328:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 919us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.431681:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4804 00000100:00100000:0.0:1715205776.432214:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.432268:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455787456 00000100:00100000:2.0:1715205776.432297:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 535 00000100:00100000:2.0:1715205776.432299:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131479300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+224:11754:x1798520455787456:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.432473:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880131479300 x1798520455787456/t330712482700(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.432510:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131479300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+225:11754:x1798520455787456:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 209us (299us total) trans 330712482700 rc 0/0 00000100:00100000:2.0:1715205776.432516:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 535 00000100:00100000:1.0:1715205776.434675:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.434741:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455787584 00000100:00100000:0.0:1715205776.434794:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1998 00000100:00100000:0.0:1715205776.434798:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+225:11754:x1798520455787584:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.434819:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.434836:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305007eb4 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23b11 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.434916:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007ebb lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.434929:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305007ea6 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b03 expref: 226 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.434934:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007ebb lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.434966:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305007ea6 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b03 expref: 226 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.434976:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305007ea6 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b03 expref: 226 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.434987:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801314784c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037760:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.435053:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b50f780 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.436335:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801314784c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037760:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.436356:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007ebb lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.436422:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.436684:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455787648 00010000:00010000:2.0:1715205776.436708:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305007ea6 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b03 expref: 227 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.436752:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4805 00000100:00100000:2.0:1715205776.436757:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364ae880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+227:1831:x1798520455787648:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1715205776.436768:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.436772:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305007ea6 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b03 expref: 227 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.436782:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305007ea6 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b03 expref: 227 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.436798:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305007ea6 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b03 expref: 227 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.436810:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1016:0x0].0x0 (ffff8800b7b20f00) 00010000:00010000:2.0:1715205776.436813:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007ebb lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.436820:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007ebb lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.436826:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007ebb lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.436859:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205776.436888:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364ae880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+226:1831:x1798520455787648:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 131us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.436894:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4805 00010000:00010000:1.0:1715205776.436993:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007ebb lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.437000:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007ebb lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205776.437018:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1016:0x0]: returning size 2048 00010000:00010000:1.0:1715205776.437134:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305007eb4 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b11 expref: 227 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.437147:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007ebb lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b11 expref: 226 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.437153:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1016:0x0].0x0 (ffff8800b7b20f00) 00010000:00010000:1.0:1715205776.437155:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205776.437157:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83eac0, rc 0) 00010000:00000080:1.0:1715205776.437161:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b4280 x1798520455787584/t330712482701(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.437208:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+226:11754:x1798520455787584:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2409us (2536us total) trans 330712482701 rc 0/0 00000100:00100000:1.0:1715205776.437214:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1998 00000100:00100000:1.0:1715205776.438198:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.438542:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455787712 00000100:00100000:0.0:1715205776.438596:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 1999 00000100:00100000:0.0:1715205776.438605:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364a84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+226:11754:x1798520455787712:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.438649:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.438661:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305007ec9 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23b18 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.438706:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007ed0 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.438717:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007ebb lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b11 expref: 227 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.438724:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007ed0 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.438764:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007ebb lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b11 expref: 227 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.438774:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007ebb lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b11 expref: 227 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.438784:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801314784c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037824:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.438823:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b50f780 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.439954:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801314784c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037824:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.439971:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007ed0 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.440126:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.440235:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455787776 00010000:00010000:0.0:1715205776.440258:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007ebb lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b11 expref: 228 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.440285:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4806 00000100:00100000:0.0:1715205776.440289:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364acc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+228:1830:x1798520455787776:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1715205776.440302:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.440306:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007ebb lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b11 expref: 228 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.440314:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007ebb lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b11 expref: 228 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.440329:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007ebb lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b11 expref: 228 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.440343:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1016:0x0].0x0 (ffff8800b7b20f00) 00010000:00010000:0.0:1715205776.440346:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007ed0 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.440353:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007ed0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.440358:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007ed0 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.440370:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.440405:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364acc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+227:1830:x1798520455787776:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 115us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.440410:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4806 00010000:00010000:1.0:1715205776.440446:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007ed0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.440451:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007ed0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205776.440480:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1016:0x0]: returning size 2048 00000004:00200000:1.0:1715205776.440483:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205776.440493:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007ed0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.440500:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007ed0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.440516:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305007ec9 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b18 expref: 227 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.440526:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007ed0 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b18 expref: 226 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.440531:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1016:0x0].0x0 (ffff8800b7b20f00) 00010000:00010000:1.0:1715205776.440533:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205776.440534:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83c480, rc 0) 00010000:00000080:1.0:1715205776.440538:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364a84c0 x1798520455787712/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.440555:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364a84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+226:11754:x1798520455787712:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1950us (2360us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.440563:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 1999 00000100:00100000:2.0:1715205776.442330:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.442401:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455787840 00000100:00100000:1.0:1715205776.442572:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2000 00000100:00100000:1.0:1715205776.442577:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+226:11754:x1798520455787840:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.442592:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.442644:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af4305007ed7 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23b1f expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.442790:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305007ede lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.442802:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305007ede lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.442810:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305007ede lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.442820:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af4305007ee5 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.442824:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af4305007ee5 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.442829:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af4305007ee5 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.442886:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305007ede lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.442895:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305007ede lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.442900:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305007ede lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.442904:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd9b840 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.442907:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305007ede lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.442912:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305007ede lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.442920:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205776.442922:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.442924:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305007ede lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.442928:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305007ede lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.442935:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af4305007ee5 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.442940:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af4305007ee5 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.442943:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af4305007ee5 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.442951:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd9ad00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.442953:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af4305007ee5 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.442956:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af4305007ee5 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.442961:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x54f6b75a (ffff880129f26600) 00010000:00010000:1.0:1715205776.442963:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.442964:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af4305007ee5 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.442968:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af4305007ee5 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.442999:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af4305007ed7 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b1f expref: 227 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.443004:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af4305007ed7 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b1f expref: 227 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.443010:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9a1c0, rc 0) 00010000:00000080:1.0:1715205776.443013:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb1300 x1798520455787840/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.443341:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+226:11754:x1798520455787840:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 762us (1013us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205776.443346:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2000 00000100:00100000:2.0:1715205776.445373:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.445436:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455787904 00000100:00100000:1.0:1715205776.445482:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2001 00000100:00100000:1.0:1715205776.445487:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+226:11754:x1798520455787904:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.445500:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.445511:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007eec lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23b26 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.445536:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007eec lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b26 expref: 227 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.445545:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007eec lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b26 expref: 227 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.445551:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205776.445553:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.445556:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd98d80, rc 0) 00010000:00000080:1.0:1715205776.445559:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb5a40 x1798520455787904/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 328/344 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.445590:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+227:11754:x1798520455787904:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 103us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.445596:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2001 00000100:00100000:0.0:1715205776.447191:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.447264:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455787968 00000100:00100000:2.0:1715205776.447288:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 536 00000100:00100000:2.0:1715205776.447292:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c04050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+227:11754:x1798520455787968:12345-192.168.204.8@tcp:37:dbench.0 00000400:00000080:1.0:1715205776.449251:0:17425:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1715205776.449254:0:17425:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: test_70b fail mds1 3 times 00010000:00000080:3.0:1715205776.450104:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880093c04050 x1798520455787968/t0(0) o37->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 448/440 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.450155:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c04050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+227:11754:x1798520455787968:12345-192.168.204.8@tcp:37:dbench.0 Request processed in 2861us (2965us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.450162:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 536 00000100:00100000:0.0:1715205776.452281:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.452326:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455788032 00000100:00100000:1.0:1715205776.452367:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2002 00000100:00100000:1.0:1715205776.452372:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880131479300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+227:11754:x1798520455788032:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.452388:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.452403:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007ef3 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xeb8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23b2d expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.452445:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af4305007efa lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.452456:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af4305007efa lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.452465:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af4305007efa lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205776.452514:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xedf:0x0]: returning size 12800 00000004:00200000:1.0:1715205776.452517:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 26 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205776.452529:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af4305007efa lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.452546:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305007ef3 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xeb8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b2d expref: 229 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.452556:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af4305007efa lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b2d expref: 228 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.452562:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205776.452564:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1715205776.452566:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd986c0, rc 0) 00010000:00000080:1.0:1715205776.452569:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880131479300 x1798520455788032/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.452616:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880131479300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+228:11754:x1798520455788032:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 243us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.452640:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2002 00000100:00100000:0.0:1715205776.453428:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.453511:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455788160 00000100:00100000:2.0:1715205776.453569:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 537 00000100:00100000:2.0:1715205776.453575:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801314784c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+228:11754:x1798520455788160:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.453781:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801314784c0 x1798520455788160/t330712482702(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.453838:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801314784c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+229:11754:x1798520455788160:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 263us (409us total) trans 330712482702 rc 0/0 00000100:00100000:2.0:1715205776.453844:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 537 00000100:00100000:3.0:1715205776.455384:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.455491:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455788288 00000100:00100000:1.0:1715205776.455520:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2003 00000100:00100000:1.0:1715205776.455525:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6deaac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+229:11754:x1798520455788288:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.455540:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.455551:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305007f01 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23b34 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.455611:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007f08 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.455639:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305007a7e lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2396d expref: 230 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.455645:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007f08 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.455669:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305007a7e lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2396d expref: 230 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.455678:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305007a7e lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2396d expref: 230 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.455687:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801364ab440 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037888:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.455725:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099530240 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.456698:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801364ab440 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037888:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.456712:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007f08 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.457013:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.457048:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455788352 00010000:00010000:1.0:1715205776.457060:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305007a7e lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2396d expref: 231 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.457078:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4807 00000100:00100000:1.0:1715205776.457081:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+231:1831:x1798520455788352:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1715205776.457086:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.457088:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305007a7e lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2396d expref: 231 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.457093:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305007a7e lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2396d expref: 231 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.457102:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305007a7e lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2396d expref: 231 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.457110:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:1.0:1715205776.457112:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007f08 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.457116:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007f08 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.457119:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007f08 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.457127:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.457133:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007f08 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.457138:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007f08 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.457143:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+230:1831:x1798520455788352:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 62us (131us total) trans 0 rc 0/0 00000004:00200000:0.0:1715205776.457147:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee4:0x0]: returning size 260096 00000100:00100000:1.0:1715205776.457149:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4807 00010000:00010000:0.0:1715205776.457232:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305007f01 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b34 expref: 231 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.457246:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007f08 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b34 expref: 230 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.457250:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:0.0:1715205776.457252:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205776.457253:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9bcc0, rc 0) 00010000:00000080:0.0:1715205776.457257:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6deaac0 x1798520455788288/t330712482703(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.457274:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6deaac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+230:11754:x1798520455788288:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1749us (1893us total) trans 330712482703 rc 0/0 00000100:00100000:0.0:1715205776.457279:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2003 00000100:00100000:1.0:1715205776.458445:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.458512:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455788416 00000100:00100000:0.0:1715205776.458533:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2004 00000100:00100000:0.0:1715205776.458537:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364ae880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+230:11754:x1798520455788416:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.458549:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.458557:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e1c0/0xb608af4305007f16 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23b3b expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.458586:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007f1d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.458594:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007f08 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b34 expref: 231 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.458599:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007f1d lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.458638:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007f08 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b34 expref: 231 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.458647:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007f08 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b34 expref: 231 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.458655:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013147c740 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037952:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.458691:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b50f180 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.459352:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013147c740 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456037952:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.459355:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:0.0:1715205776.459363:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007f1d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.459373:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455788480 00010000:00010000:1.0:1715205776.459385:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007f08 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b34 expref: 232 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.459402:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4808 00000100:00100000:1.0:1715205776.459406:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364acc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+232:1831:x1798520455788480:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1715205776.459412:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.459416:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007f08 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b34 expref: 232 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.459423:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007f08 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b34 expref: 232 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.459433:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305007f08 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b34 expref: 232 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.459441:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:1.0:1715205776.459443:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007f1d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.459449:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007f1d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.459454:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007f1d lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.459475:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.459489:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007f1d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.459493:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364acc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+231:1831:x1798520455788480:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 86us (138us total) trans 0 rc 0/0 00010000:00010000:0.0:1715205776.459495:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007f1d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.459498:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4808 00000004:00200000:0.0:1715205776.459517:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee4:0x0]: returning size 260096 00000004:00200000:0.0:1715205776.459520:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205776.459531:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007f1d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.459537:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007f1d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.459550:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e1c0/0xb608af4305007f16 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b3b expref: 231 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.459563:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007f1d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b3b expref: 230 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.459568:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:0.0:1715205776.459570:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205776.459571:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83f840, rc 0) 00010000:00000080:0.0:1715205776.459575:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364ae880 x1798520455788416/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.459611:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364ae880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+230:11754:x1798520455788416:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1073us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.459633:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2004 00000100:00100000:1.0:1715205776.461033:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.461093:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455788544 00000100:00100000:0.0:1715205776.461122:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2005 00000100:00100000:0.0:1715205776.461126:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364ab440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+230:11754:x1798520455788544:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.461136:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.461146:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af4305007f24 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23b42 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.461172:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007f2b lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.461180:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007f2b lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.461187:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007f2b lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.461201:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305007f32 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.461205:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305007f32 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.461210:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305007f32 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.461261:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007f2b lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.461266:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007f2b lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.461270:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007f2b lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.461275:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83cfc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.461277:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007f2b lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.461282:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007f2b lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.461293:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.461295:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.461297:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007f2b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.461305:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305007f2b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.461312:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305007f32 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.461316:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305007f32 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.461320:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305007f32 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.461324:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83fa80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.461325:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305007f32 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.461328:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305007f32 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.461332:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x54f6b75a (ffff8800b7b20100) 00010000:00010000:0.0:1715205776.461334:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.461335:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305007f32 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.461339:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305007f32 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.461366:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af4305007f24 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b42 expref: 231 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.461374:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af4305007f24 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b42 expref: 231 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.461381:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83fcc0, rc 0) 00010000:00000080:0.0:1715205776.461384:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801364ab440 x1798520455788544/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.461409:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364ab440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+230:11754:x1798520455788544:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 282us (378us total) trans 0 rc 301/301 00000100:00100000:0.0:1715205776.461414:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2005 00000100:00100000:2.0:1715205776.462430:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.462548:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455788672 00000100:00100000:3.0:1715205776.462574:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 538 00000100:00100000:3.0:1715205776.462578:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+230:11754:x1798520455788672:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:3.0:1715205776.462791:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb3900 x1798520455788672/t330712482704(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.463023:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+231:11754:x1798520455788672:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 444us (594us total) trans 330712482704 rc 0/0 00000100:00100000:3.0:1715205776.463029:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 538 00000100:00100000:2.0:1715205776.464403:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.464455:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455788800 00000100:00100000:0.0:1715205776.464481:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2006 00000100:00100000:0.0:1715205776.464491:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+231:11754:x1798520455788800:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.464502:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.464513:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af4305007f39 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23b49 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.464558:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007f40 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.464568:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007f1d lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b3b expref: 232 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.464574:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007f40 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.464597:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007f1d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b3b expref: 232 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.464613:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007f1d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b3b expref: 232 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.464639:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013147c740 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456038016:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.464685:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b50f180 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.465609:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.465649:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013147c740 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456038016:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.465655:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455788864 00010000:00010000:1.0:1715205776.465663:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007f40 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.465678:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007f1d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b3b expref: 233 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.465724:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4809 00000100:00100000:3.0:1715205776.465728:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb2140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+233:1829:x1798520455788864:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205776.465747:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.465751:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007f1d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b3b expref: 233 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.465760:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007f1d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b3b expref: 233 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.465777:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007f1d lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b3b expref: 233 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.465787:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:3.0:1715205776.465790:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007f40 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.465795:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007f40 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.465801:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007f40 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.465814:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205776.465832:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb2140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+232:1829:x1798520455788864:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 105us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.465838:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4809 00010000:00010000:1.0:1715205776.465889:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007f40 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.465895:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007f40 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205776.465915:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee4:0x0]: returning size 260096 00010000:00010000:1.0:1715205776.465999:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af4305007f39 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b49 expref: 233 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.466010:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007f40 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b49 expref: 232 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.466016:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:1.0:1715205776.466018:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205776.466019:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83f3c0, rc 0) 00010000:00000080:1.0:1715205776.466022:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb76c0 x1798520455788800/t330712482705(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.466052:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+232:11754:x1798520455788800:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1566us (1650us total) trans 330712482705 rc 0/0 00000100:00100000:1.0:1715205776.466058:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2006 00000100:00100000:2.0:1715205776.469531:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.469583:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455788928 00000100:00100000:0.0:1715205776.469631:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2007 00000100:00100000:0.0:1715205776.469635:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb0980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+232:11754:x1798520455788928:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.469651:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.469663:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af4305007f4e lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23b50 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.469701:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af4305007f55 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.469711:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007f40 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b49 expref: 233 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.469717:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af4305007f55 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.469757:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007f40 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b49 expref: 233 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.469767:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007f40 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b49 expref: 233 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.469780:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013147c740 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456038080:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.469826:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b50f600 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.470814:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.470849:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455788992 00010000:00010000:2.0:1715205776.470866:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007f40 lrc: 5/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b49 expref: 234 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.470881:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013147c740 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456038080:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.470883:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4810 00000100:00100000:2.0:1715205776.470887:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ded0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+234:1830:x1798520455788992:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1715205776.470894:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.470896:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af4305007f55 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.470897:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007f40 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b49 expref: 234 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.470904:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007f40 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b49 expref: 234 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.470917:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305007f40 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b49 expref: 234 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.470926:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:2.0:1715205776.470929:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af4305007f55 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.470935:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af4305007f55 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.470939:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af4305007f55 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.470956:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.470962:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af4305007f55 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.470969:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af4305007f55 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.470991:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ded0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+233:1830:x1798520455788992:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 94us (168us total) trans 0 rc 0/0 00000004:00200000:0.0:1715205776.470994:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee4:0x0]: returning size 260096 00000004:00200000:0.0:1715205776.470997:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:2.0:1715205776.470997:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4810 00000004:00010000:0.0:1715205776.471007:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af4305007f55 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.471014:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af4305007f55 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.471028:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af4305007f4e lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b50 expref: 233 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.471038:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af4305007f55 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b50 expref: 232 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.471042:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:0.0:1715205776.471044:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205776.471045:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83d680, rc 0) 00010000:00000080:0.0:1715205776.471048:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb0980 x1798520455788928/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.471072:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb0980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+232:11754:x1798520455788928:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1436us (1544us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.471077:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2007 00000100:00100000:0.0:1715205776.472337:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.472383:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455789056 00000100:00100000:1.0:1715205776.472417:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2008 00000100:00100000:1.0:1715205776.472421:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+232:11754:x1798520455789056:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.472431:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.472440:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007f5c lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23b57 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.472468:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007f63 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.472475:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007f63 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.472480:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007f63 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.472487:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007f6a lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.472490:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007f6a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.472494:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007f6a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.472536:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007f63 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.472540:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007f63 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.472545:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007f63 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.472550:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd9a880 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.472552:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007f63 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.472557:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007f63 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.472564:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205776.472566:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.472567:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007f63 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.472572:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305007f63 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.472578:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007f6a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.472586:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007f6a lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.472591:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007f6a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.472594:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd99200 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.472596:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007f6a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.472600:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007f6a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.472605:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x6cad4e9d (ffff8800940a3c00) 00010000:00010000:1.0:1715205776.472607:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.472608:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007f6a lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.472611:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af4305007f6a lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.472663:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007f5c lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b57 expref: 233 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.472669:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305007f5c lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b57 expref: 233 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.472674:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd998c0, rc 0) 00010000:00000080:1.0:1715205776.472677:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147f6c0 x1798520455789056/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.472709:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+232:11754:x1798520455789056:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 287us (373us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205776.472714:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2008 00000100:00100000:2.0:1715205776.474342:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.474415:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455789120 00000100:00100000:0.0:1715205776.474442:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2009 00000100:00100000:0.0:1715205776.474446:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+232:11754:x1798520455789120:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.474459:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.474467:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e640/0xb608af4305007f71 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23b5e expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.474492:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af4305007f78 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.474499:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af4305007f78 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.474505:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af4305007f78 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.474513:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af4305007f7f lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6cfa4d9f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.474518:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af4305007f7f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.474523:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af4305007f7f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.474557:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af4305007f78 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.474562:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af4305007f78 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.474567:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af4305007f78 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.474570:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83f180 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.474572:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af4305007f78 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.474577:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af4305007f78 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.474584:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.474586:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.474588:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af4305007f78 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.474592:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af4305007f78 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.474600:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af4305007f7f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.474605:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af4305007f7f lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.474608:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af4305007f7f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.474632:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83df80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.474635:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af4305007f7f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.474639:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af4305007f7f lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.474646:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x6cfa4d9f (ffff8800b7b20b00) 00010000:00010000:0.0:1715205776.474647:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.474648:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af4305007f7f lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.474652:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af4305007f7f lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.474680:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e640/0xb608af4305007f71 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b5e expref: 233 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.474685:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e640/0xb608af4305007f71 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b5e expref: 233 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.474691:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83e640, rc 0) 00010000:00000080:0.0:1715205776.474694:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb2600 x1798520455789120/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.474719:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+232:11754:x1798520455789120:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 273us (379us total) trans 0 rc 301/301 00000100:00100000:0.0:1715205776.474725:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2009 00000100:00100000:2.0:1715205776.476290:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.476342:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455789248 00000100:00100000:0.0:1715205776.476370:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2010 00000100:00100000:0.0:1715205776.476374:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb3dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+232:11754:x1798520455789248:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.476385:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.476386:0:14185:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1715205776.476399:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af4305007efa lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b2d expref: 232 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.476408:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305007eec lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b26 expref: 231 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.476414:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.476416:0:14185:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.476421:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305007f86 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23b65 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.476485:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305007f8d lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.476493:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305007f8d lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.476498:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305007f8d lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.476507:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305007f94 lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.476511:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305007f94 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.476517:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305007f94 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715205776.476815:0:14185:0:(osp_object.c:1645:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x100000000:0x17bc:0x0], index 0: 0 00010000:00010000:0.0:1715205776.476918:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007f9b lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.476924:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007f9b lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.476930:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007f9b lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.476951:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305007f8d lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.476955:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305007f8d lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.476959:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305007f8d lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.476964:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83e880 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.476966:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305007f8d lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.476971:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305007f8d lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.476980:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.476982:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.476983:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305007f8d lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.476987:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305007f8d lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715205776.476994:0:14185:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88009edb3dc0 reply state ffff8800a1614000 transno 330712482706 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305007f94 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.477007:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305007f86 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b65 expref: 233 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.477014:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007f9b lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b65 expref: 232 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.477019:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1017:0x0].0x0 (ffff8800b7b20200) 00010000:00010000:0.0:1715205776.477020:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1715205776.477021:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83eac0, rc 0) 00010000:00000080:0.0:1715205776.477025:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb3dc0 x1798520455789248/t330712482706(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 664/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.477140:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb3dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+233:11754:x1798520455789248:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 764us (851us total) trans 330712482706 rc 0/0 00000100:00100000:0.0:1715205776.477151:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2010 00010000:00010000:3.0:1715205776.477863:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305007f94 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.477869:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305007f94 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.477873:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305007f94 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.477878:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83d8c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205776.477880:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305007f94 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.477892:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305007f94 lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.477900:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x6cad4e9d (ffff8800b7b20a00) 00010000:00010000:3.0:1715205776.477902:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205776.477903:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305007f94 lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.477907:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305007f94 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.478135:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.478220:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455789312 00000100:00100000:0.0:1715205776.478272:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2011 00000100:00100000:0.0:1715205776.478278:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb3440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+232:11754:x1798520455789312:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.478298:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.478314:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305007fa9 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23b6c expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.478358:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007fb0 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.478367:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007fb0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.478374:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007fb0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.478399:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205776.478410:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007fb0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.478418:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007fb0 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.478434:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305007fa9 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b6c expref: 234 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.478449:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007fb0 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b6c expref: 233 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.478455:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1017:0x0].0x0 (ffff8800b7b20200) 00010000:00010000:0.0:1715205776.478457:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205776.478460:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83cb40, rc 0) 00010000:00000080:0.0:1715205776.478463:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb3440 x1798520455789312/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.478519:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb3440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+233:11754:x1798520455789312:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 240us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.478525:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2011 00000100:00100000:2.0:1715205776.479340:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.479392:0:19961:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455789376 00000100:00100000:0.0:1715205776.479422:0:19961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14699 00000100:00100000:0.0:1715205776.479427:0:19961:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+41:1828:x1798520455789376:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.479439:0:19961:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.479452:0:19961:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c83dd40/0xb608af4305007fb7 lrc: 2/0,0 mode: --/PR res: [0x17bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23b73 expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1715205776.479469:0:19961:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100000000:0x17bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1715205776.479482:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205776.479484:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205776.479490:0:19961:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c83dd40/0xb608af4305007fb7 lrc: 3/0,0 mode: PR/PR res: [0x17bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b73 expref: 42 pid: 19961 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1715205776.479499:0:19961:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c83dd40/0xb608af4305007fb7 lrc: 3/0,0 mode: PR/PR res: [0x17bc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b73 expref: 42 pid: 19961 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1715205776.479508:0:19961:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83dd40, rc 0) 00000100:00100000:0.0:1715205776.479543:0:19961:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+42:1828:x1798520455789376:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 115us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.479548:0:19961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14699 00000100:00100000:3.0:1715205776.480950:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.480970:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455789504 00000100:00100000:2.0:1715205776.481003:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 539 00000100:00100000:2.0:1715205776.481007:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6def200 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+233:11754:x1798520455789504:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.481550:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6def200 x1798520455789504/t330712482707(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.481726:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6def200 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+234:11754:x1798520455789504:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 715us (775us total) trans 330712482707 rc 0/0 00000100:00100000:2.0:1715205776.481741:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 539 00000100:00100000:0.0:1715205776.482784:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.482805:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455789632 00000100:00100000:0.0:1715205776.482829:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2012 00000100:00100000:0.0:1715205776.482833:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013147c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+234:11754:x1798520455789632:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.482843:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.482854:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007fbe lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23b7a expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.482960:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af4305007fc5 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.482972:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007fb0 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b6c expref: 235 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.482978:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af4305007fc5 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.482999:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007fb0 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b6c expref: 235 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.483008:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007fb0 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b6c expref: 235 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.483017:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a66d8980 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456038144:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.483060:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009b50f180 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.484386:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.484407:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455789696 00000100:00100000:3.0:1715205776.484413:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a66d8980 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456038144:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.484420:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007fb0 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b6c expref: 236 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.484426:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af4305007fc5 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.484438:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4811 00000100:00100000:2.0:1715205776.484441:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c6d40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+236:1831:x1798520455789696:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1715205776.484449:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.484452:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007fb0 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b6c expref: 236 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.484459:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007fb0 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b6c expref: 236 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.484471:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305007fb0 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b6c expref: 236 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.484480:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1017:0x0].0x0 (ffff8800b7b20200) 00010000:00010000:2.0:1715205776.484482:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af4305007fc5 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.484488:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af4305007fc5 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.484493:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af4305007fc5 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.484506:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205776.484522:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c6d40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+235:1831:x1798520455789696:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 80us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.484528:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4811 00010000:00010000:3.0:1715205776.484857:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af4305007fc5 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.484864:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af4305007fc5 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205776.484876:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1017:0x0]: returning size 0 00010000:00010000:3.0:1715205776.484956:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af4305007fbe lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b7a expref: 236 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.484966:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af4305007fc5 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b7a expref: 235 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.484971:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1017:0x0].0x0 (ffff8800b7b20200) 00010000:00010000:3.0:1715205776.484973:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1715205776.484974:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83fcc0, rc 0) 00010000:00000080:3.0:1715205776.484977:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013147c740 x1798520455789632/t330712482708(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.485010:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013147c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+235:11754:x1798520455789632:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2176us (2226us total) trans 330712482708 rc 0/0 00000100:00100000:3.0:1715205776.485016:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2012 00000100:00100000:2.0:1715205776.485766:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.485796:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455789760 00000100:00100000:3.0:1715205776.485810:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2013 00000100:00100000:3.0:1715205776.485813:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+235:11754:x1798520455789760:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.485821:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.485826:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305007fd3 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23b81 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.485847:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007fda lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.485852:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af4305007fc5 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b7a expref: 236 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.485855:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007fda lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.485865:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af4305007fc5 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b7a expref: 236 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.485873:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af4305007fc5 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b7a expref: 236 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.485878:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6dec740 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456038208:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.485898:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099b38c00 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.486649:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6dec740 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456038208:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.486660:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007fda lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.486940:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.486973:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455789824 00010000:00010000:2.0:1715205776.486983:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af4305007fc5 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b7a expref: 237 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.486995:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4812 00000100:00100000:2.0:1715205776.486998:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66d8980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+237:1831:x1798520455789824:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1715205776.487003:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.487005:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af4305007fc5 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b7a expref: 237 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.487010:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af4305007fc5 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b7a expref: 237 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.487016:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af4305007fc5 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b7a expref: 237 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.487022:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1017:0x0].0x0 (ffff8800b7b20200) 00010000:00010000:2.0:1715205776.487023:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007fda lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.487027:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007fda lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.487030:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007fda lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.487037:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205776.487048:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66d8980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+236:1831:x1798520455789824:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 50us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.487051:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4812 00010000:00010000:1.0:1715205776.487466:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007fda lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.487472:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007fda lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205776.487492:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1017:0x0]: returning size 0 00000004:00200000:1.0:1715205776.487495:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205776.487505:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007fda lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.487512:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007fda lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.487525:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305007fd3 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b81 expref: 236 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.487534:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007fda lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b81 expref: 235 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.487542:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1017:0x0].0x0 (ffff8800b7b20200) 00010000:00010000:1.0:1715205776.487544:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205776.487546:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73acfc0, rc 0) 00010000:00000080:1.0:1715205776.487549:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c63c0 x1798520455789760/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.487572:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+235:11754:x1798520455789760:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1757us (1806us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.487577:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2013 00000100:00100000:1.0:1715205776.488614:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.488646:0:19961:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455789888 00000100:00100000:0.0:1715205776.488714:0:19961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14700 00000100:00100000:0.0:1715205776.488717:0:19961:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364ad0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+42:11754:x1798520455789888:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.488729:0:19961:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.488751:0:19961:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c83e640/0xb608af4305007fe1 lrc: 2/0,0 mode: --/PW res: [0x17bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23b88 expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.488768:0:19961:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c83dd40/0xb608af4305007fb7 lrc: 2/0,0 mode: PR/PR res: [0x17bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b73 expref: 43 pid: 19961 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1715205776.488775:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205776.488776:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1715205776.488778:0:19961:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c83e640/0xb608af4305007fe1 lrc: 4/0,0 mode: --/PW res: [0x17bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b88 expref: 43 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.488795:0:19961:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c83dd40/0xb608af4305007fb7 lrc: 3/0,0 mode: PR/PR res: [0x17bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b73 expref: 43 pid: 19961 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1715205776.488804:0:19961:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c83dd40/0xb608af4305007fb7 lrc: 4/0,0 mode: PR/PR res: [0x17bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b73 expref: 43 pid: 19961 timeout: 3136 lvb_type: 1 00000100:00100000:0.0:1715205776.488812:0:19961:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a1776880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:19961:1798520456038272:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.488837:0:19961:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800ac9b6d80 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.489896:0:19961:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a1776880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:19961:1798520456038272:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.489909:0:19961:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c83e640/0xb608af4305007fe1 lrc: 3/0,0 mode: --/PW res: [0x17bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b88 expref: 43 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.489919:0:19961:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83e640, rc 0) 00000100:00100000:2.0:1715205776.489924:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.489944:0:19961:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364ad0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+43:11754:x1798520455789888:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1226us (1331us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.489953:0:19961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14700 00000100:00100000:3.0:1715205776.489955:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455789952 00010000:00010000:3.0:1715205776.489971:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c83dd40/0xb608af4305007fb7 lrc: 4/0,0 mode: PR/PR res: [0x17bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b73 expref: 43 pid: 19961 timeout: 3136 lvb_type: 1 00000100:00100000:3.0:1715205776.489989:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4813 00000100:00100000:3.0:1715205776.489993:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c5f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+43:1829:x1798520455789952:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205776.489999:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.490012:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c83dd40/0xb608af4305007fb7 lrc: 4/0,0 mode: PR/PR res: [0x17bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b73 expref: 43 pid: 19961 timeout: 3136 lvb_type: 1 00010000:00010000:3.0:1715205776.490019:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c83dd40/0xb608af4305007fb7 lrc: 3/0,0 mode: PR/PR res: [0x17bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b73 expref: 43 pid: 19961 timeout: 3136 lvb_type: 1 00010000:00010000:3.0:1715205776.490034:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c83dd40/0xb608af4305007fb7 lrc: 0/0,0 mode: --/PR res: [0x17bc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b73 expref: 43 pid: 19961 timeout: 3136 lvb_type: 1 00010000:00010000:3.0:1715205776.490042:0:8315:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205776.490043:0:8315:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205776.490047:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c83e640/0xb608af4305007fe1 lrc: 2/0,0 mode: PW/PW res: [0x17bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b88 expref: 42 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.490058:0:8315:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c83e640/0xb608af4305007fe1 lrc: 3/0,0 mode: PW/PW res: [0x17bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b88 expref: 42 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.490074:0:8315:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c83e640/0xb608af4305007fe1 lrc: 3/0,0 mode: PW/PW res: [0x17bc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b88 expref: 42 pid: 19961 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.490082:0:8315:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6debdc0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8315:1798520456038336:192.168.204.8@tcp:105: 00000100:00100000:3.0:1715205776.490109:0:8315:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099b386c0 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.490920:0:8315:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6debdc0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8315:1798520456038336:192.168.204.8@tcp:105: 00010000:00010000:3.0:1715205776.490930:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205776.490961:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c5f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+42:1829:x1798520455789952:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 967us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.490967:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4813 00000100:00100000:2.0:1715205776.491451:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.491469:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455790080 00000100:00100000:0.0:1715205776.491485:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 540 00000100:00100000:0.0:1715205776.491488:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c4740 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+235:11754:x1798520455790080:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205776.491643:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c4740 x1798520455790080/t330712482709(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.491667:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c4740 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+236:11754:x1798520455790080:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 178us (216us total) trans 330712482709 rc 0/0 00000100:00100000:0.0:1715205776.491676:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 540 00000100:00100000:0.0:1715205776.493006:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.493041:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455790208 00000100:00100000:1.0:1715205776.493064:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2014 00000100:00100000:1.0:1715205776.493067:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1776880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+236:11754:x1798520455790208:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.493077:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.493088:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af4305007fe8 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23b8f expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.493135:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007fef lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.493146:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007fda lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b81 expref: 237 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.493151:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007fef lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.493168:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007fda lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b81 expref: 237 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.493176:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007fda lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b81 expref: 237 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.493184:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801364a97c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456038400:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.493215:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a6ea0c00 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.494545:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801364a97c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456038400:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.494557:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007fef lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.494814:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.494863:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455790272 00010000:00010000:3.0:1715205776.494878:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007fda lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b81 expref: 238 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.494902:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4814 00000100:00100000:3.0:1715205776.494906:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+238:1830:x1798520455790272:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1715205776.494912:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.494915:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007fda lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b81 expref: 238 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.494922:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007fda lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b81 expref: 238 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.494939:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305007fda lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b81 expref: 238 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.494951:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1017:0x0].0x0 (ffff8800b7b20200) 00010000:00010000:3.0:1715205776.494953:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007fef lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.494959:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007fef lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.494963:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007fef lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.494983:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205776.495008:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+237:1830:x1798520455790272:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 101us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.495013:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4814 00010000:00010000:2.0:1715205776.495016:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007fef lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.495024:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007fef lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.495035:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1017:0x0]: returning size 2048 00010000:00010000:2.0:1715205776.495129:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af4305007fe8 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b8f expref: 238 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.495147:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007fef lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b8f expref: 237 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.495152:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1017:0x0].0x0 (ffff8800b7b20200) 00010000:00010000:2.0:1715205776.495154:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.495155:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9b600, rc 0) 00010000:00000080:2.0:1715205776.495158:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1776880 x1798520455790208/t330712482710(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.495206:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1776880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+237:11754:x1798520455790208:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2137us (2201us total) trans 330712482710 rc 0/0 00000100:00100000:2.0:1715205776.495212:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2014 00000100:00100000:0.0:1715205776.496177:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.496220:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455790336 00000100:00100000:3.0:1715205776.496238:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2015 00000100:00100000:3.0:1715205776.496241:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1772f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+237:11754:x1798520455790336:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.496252:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.496258:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305007ffd lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23b96 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.496294:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305008004 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.496300:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007fef lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b8f expref: 238 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.496303:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305008004 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.496321:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007fef lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b8f expref: 238 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.496328:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007fef lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b8f expref: 238 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.496336:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6ded0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456038464:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.496370:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099b38cc0 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.497919:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6ded0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456038464:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.497931:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305008004 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.497932:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.497981:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455790400 00010000:00010000:2.0:1715205776.497994:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007fef lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b8f expref: 239 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.498021:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4815 00000100:00100000:2.0:1715205776.498024:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364acc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+239:1830:x1798520455790400:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1715205776.498032:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.498035:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007fef lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b8f expref: 239 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.498042:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007fef lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b8f expref: 239 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.498053:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305007fef lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b8f expref: 239 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.498062:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1017:0x0].0x0 (ffff8800b7b20200) 00010000:00010000:2.0:1715205776.498065:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305008004 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.498071:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305008004 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.498075:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305008004 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.498099:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205776.498126:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364acc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+238:1830:x1798520455790400:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 100us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.498132:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4815 00010000:00010000:3.0:1715205776.498186:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305008004 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.498191:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305008004 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205776.498214:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1017:0x0]: returning size 2048 00000004:00200000:3.0:1715205776.498217:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205776.498227:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305008004 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.498234:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305008004 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.498247:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305007ffd lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b96 expref: 238 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.498256:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305008004 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b96 expref: 237 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.498261:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1017:0x0].0x0 (ffff8800b7b20200) 00010000:00010000:3.0:1715205776.498263:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205776.498264:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ac900, rc 0) 00010000:00000080:3.0:1715205776.498292:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1772f80 x1798520455790336/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.498312:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1772f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+237:11754:x1798520455790336:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2070us (2136us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.498316:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2015 00000100:00100000:1.0:1715205776.500323:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.500360:0:18729:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455790464 00002000:00100000:0.0:1715205776.500384:0:18729:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x17bb:0x0] (0->4095) req@ffff8801364a97c0 x1798520455790464/t0(0) o4->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 4584/0 e 0 to 0 dl 1715205782 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dbench.0' 00002000:00100000:0.0:1715205776.500392:0:18729:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req ffff8801364a97c0 with x1798520455790464 ext(0->4095) 00002000:00010000:0.0:1715205776.500395:0:18729:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801364a97c0 00000100:00100000:0.0:1715205776.500417:0:18729:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 740 00000100:00100000:0.0:1715205776.500420:0:18729:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801364a97c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+42:1830:x1798520455790464:12345-192.168.204.8@tcp:4:dbench.0 00000100:00100000:0.0:1715205776.500791:0:18729:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801364a97c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+44:1830:x1798520455790464:12345-192.168.204.8@tcp:4:dbench.0 Request processed in 366us (466us total) trans 30064771480 rc 0/0 00000100:00100000:0.0:1715205776.500797:0:18729:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 740 00002000:00100000:0.0:1715205776.500801:0:18729:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x17bb:0x0] (0->4095) req@ffff8801364a97c0 x1798520455790464/t30064771480(0) o4->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 4584/448 e 0 to 0 dl 1715205782 ref 1 fl Complete:/0/0 rc 0/0 job:'dbench.0' 00002000:00100000:0.0:1715205776.500812:0:18729:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req ffff8801364a97c0 with x1798520455790464 ext(0->4095) 00002000:00010000:0.0:1715205776.500815:0:18729:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801364a97c0 00000100:00100000:0.0:1715205776.501836:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.501878:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455790528 00000100:00100000:3.0:1715205776.501901:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2016 00000100:00100000:3.0:1715205776.501903:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fe880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+237:11754:x1798520455790528:12345-192.168.204.8@tcp:44:dbench.0 00000001:00080000:0.0:1715205776.509928:0:14242:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-MDT0000: transno 330712482709 is committed 00000001:00080000:0.0:1715205776.509990:0:14242:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-MDT0000: transno 330712482710 is committed 00010000:00000080:0.0:1715205776.510070:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6fe880 x1798520455790528/t0(0) o44->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 448/440 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.510121:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fe880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+125:11754:x1798520455790528:12345-192.168.204.8@tcp:44:dbench.0 Request processed in 8215us (8285us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.510129:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2016 00000100:00100000:2.0:1715205776.511344:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.511382:0:19961:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455790592 00000100:00100000:0.0:1715205776.511407:0:19961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14701 00000100:00100000:0.0:1715205776.511411:0:19961:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+44:1831:x1798520455790592:12345-192.168.204.8@tcp:16:dbench.0 00000001:00080000:1.0:1715205776.527366:0:24534:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0000: transno 30064771480 is committed 00000100:00100000:0.0:1715205776.527494:0:19961:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+42:1831:x1798520455790592:12345-192.168.204.8@tcp:16:dbench.0 Request processed in 16078us (16149us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.527503:0:19961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14701 00000100:00100000:1.0:1715205776.530358:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.530449:0:18729:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455790656 00002000:00100000:0.0:1715205776.530485:0:18729:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x15dc:0x0] (0->4095) req@ffff8800a61b2140 x1798520455790656/t0(0) o4->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 4584/0 e 0 to 0 dl 1715205782 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dbench.0' 00002000:00100000:0.0:1715205776.530494:0:18729:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a61b2140 with x1798520455790656 ext(0->4095) 00002000:00010000:0.0:1715205776.530499:0:18729:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a61b2140 00000100:00100000:0.0:1715205776.530521:0:18729:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 741 00000100:00100000:0.0:1715205776.530525:0:18729:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b2140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+45:1829:x1798520455790656:12345-192.168.204.8@tcp:4:dbench.0 00000100:00100000:0.0:1715205776.530902:0:18729:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b2140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+47:1829:x1798520455790656:12345-192.168.204.8@tcp:4:dbench.0 Request processed in 375us (548us total) trans 4294970700 rc 0/0 00000100:00100000:0.0:1715205776.530909:0:18729:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 741 00002000:00100000:0.0:1715205776.530914:0:18729:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x100010000:0x15dc:0x0] (0->4095) req@ffff8800a61b2140 x1798520455790656/t4294970700(0) o4->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 4584/448 e 0 to 0 dl 1715205782 ref 1 fl Complete:/0/0 rc 0/0 job:'dbench.0' 00002000:00100000:0.0:1715205776.530920:0:18729:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a61b2140 with x1798520455790656 ext(0->4095) 00002000:00010000:0.0:1715205776.530923:0:18729:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a61b2140 00000100:00100000:1.0:1715205776.532443:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.532570:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455790720 00000100:00100000:0.0:1715205776.532644:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2017 00000100:00100000:0.0:1715205776.532649:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a61b1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+125:11754:x1798520455790720:12345-192.168.204.8@tcp:44:dbench.0 00010000:00000080:0.0:1715205776.532714:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a61b1c80 x1798520455790720/t0(0) o44->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 448/440 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.532781:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a61b1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+125:11754:x1798520455790720:12345-192.168.204.8@tcp:44:dbench.0 Request processed in 131us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.532786:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2017 00000100:00100000:2.0:1715205776.534663:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.534706:0:19961:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455790784 00000100:00100000:0.0:1715205776.534859:0:19961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14702 00000100:00100000:0.0:1715205776.534864:0:19961:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c3440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+47:1830:x1798520455790784:12345-192.168.204.8@tcp:16:dbench.0 00000100:00100000:0.0:1715205776.551214:0:19961:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c3440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+47:1830:x1798520455790784:12345-192.168.204.8@tcp:16:dbench.0 Request processed in 16345us (16549us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.551232:0:19961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14702 00000001:00080000:0.0:1715205776.551267:0:10032:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0001: transno 4294970700 is committed 00000100:00100000:1.0:1715205776.552990:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.553127:0:18729:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455790848 00002000:00100000:0.0:1715205776.553160:0:18729:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x17bc:0x0] (0->4095) req@ffff88012f111c80 x1798520455790848/t0(0) o4->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 4584/0 e 0 to 0 dl 1715205782 ref 1 fl New:/0/ffffffff rc 0/-1 job:'dbench.0' 00002000:00100000:0.0:1715205776.553169:0:18729:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f111c80 with x1798520455790848 ext(0->4095) 00002000:00010000:0.0:1715205776.553174:0:18729:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f111c80 00000100:00100000:0.0:1715205776.553204:0:18729:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 742 00000100:00100000:0.0:1715205776.553208:0:18729:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f111c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+42:1829:x1798520455790848:12345-192.168.204.8@tcp:4:dbench.0 00000100:00100000:0.0:1715205776.553571:0:18729:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f111c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+44:1829:x1798520455790848:12345-192.168.204.8@tcp:4:dbench.0 Request processed in 361us (585us total) trans 30064771481 rc 0/0 00000100:00100000:0.0:1715205776.553577:0:18729:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 742 00002000:00100000:0.0:1715205776.553582:0:18729:0:(ofd_dev.c:2632:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x100000000:0x17bc:0x0] (0->4095) req@ffff88012f111c80 x1798520455790848/t30064771481(0) o4->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 4584/448 e 0 to 0 dl 1715205782 ref 1 fl Complete:/0/0 rc 0/0 job:'dbench.0' 00002000:00100000:0.0:1715205776.553589:0:18729:0:(ofd_dev.c:2491:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f111c80 with x1798520455790848 ext(0->4095) 00002000:00010000:0.0:1715205776.553591:0:18729:0:(ofd_dev.c:2637:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f111c80 00000100:00100000:1.0:1715205776.555003:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.555067:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455790912 00000100:00100000:0.0:1715205776.555097:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2018 00000100:00100000:0.0:1715205776.555101:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f113440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+125:11754:x1798520455790912:12345-192.168.204.8@tcp:44:dbench.0 00010000:00000080:0.0:1715205776.555142:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f113440 x1798520455790912/t0(0) o44->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 448/440 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.555176:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f113440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+125:11754:x1798520455790912:12345-192.168.204.8@tcp:44:dbench.0 Request processed in 75us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.555182:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2018 00000100:00100000:2.0:1715205776.556276:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.556343:0:19961:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455790976 00000100:00100000:0.0:1715205776.556362:0:19961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14703 00000100:00100000:0.0:1715205776.556365:0:19961:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+44:1831:x1798520455790976:12345-192.168.204.8@tcp:16:dbench.0 00000001:00080000:1.0:1715205776.574869:0:24534:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0000: transno 30064771481 is committed 00000100:00100000:2.0:1715205776.574918:0:19961:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c3dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+42:1831:x1798520455790976:12345-192.168.204.8@tcp:16:dbench.0 Request processed in 18549us (18641us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.574932:0:19961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14703 00000100:00100000:2.0:1715205776.578878:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.578975:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455791104 00000100:00100000:1.0:1715205776.579017:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2019 00000100:00100000:1.0:1715205776.579022:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+125:11754:x1798520455791104:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.579048:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.579062:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af430500800b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23b9d expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.579134:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af4305008012 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.579146:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af4305008012 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.579154:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af4305008012 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205776.579164:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1014:0x0]: returning size 2048 00010000:00010000:1.0:1715205776.579297:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af430500800b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b9d expref: 128 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.579324:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af4305008012 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b9d expref: 127 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.579330:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:1.0:1715205776.579332:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1715205776.579335:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9b3c0, rc 0) 00010000:00000080:1.0:1715205776.579338:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c7200 x1798520455791104/t330712482711(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.579385:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+127:11754:x1798520455791104:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 362us (516us total) trans 330712482711 rc 0/0 00000100:00100000:1.0:1715205776.579391:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2019 00000100:00100000:1.0:1715205776.581682:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.581789:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455791168 00000100:00100000:1.0:1715205776.581795:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.581834:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 519 00000100:00100000:2.0:1715205776.581839:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1163c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+127:1828:x1798520455791168:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1715205776.581852:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.581874:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af4305008012 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b9d expref: 127 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.581888:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:2.0:1715205776.581891:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.581892:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455791296 00000100:00100000:0.0:1715205776.581938:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 541 00000100:00100000:2.0:1715205776.581940:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1163c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+127:1828:x1798520455791168:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 100us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.581943:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f117200 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+127:11754:x1798520455791296:12345-192.168.204.8@tcp:35:dbench.0 00000100:00100000:2.0:1715205776.581947:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 519 00010000:00000080:0.0:1715205776.582059:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f117200 x1798520455791296/t330712482712(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.582093:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f117200 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+127:11754:x1798520455791296:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 151us (299us total) trans 330712482712 rc 0/0 00000100:00100000:0.0:1715205776.582098:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 541 00000100:00100000:1.0:1715205776.583217:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.583268:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455791424 00000100:00100000:2.0:1715205776.583302:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2020 00000100:00100000:2.0:1715205776.583307:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1150c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+127:11754:x1798520455791424:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.583328:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.583342:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af4305008020 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23ba4 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.583419:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305008027 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.583432:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050076cd lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23808 expref: 128 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.583441:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305008027 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.583467:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050076cd lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23808 expref: 128 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.583475:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050076cd lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23808 expref: 128 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.583484:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d4c5580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456038528:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.583543:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a91586c0 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.584546:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d4c5580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456038528:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.584567:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305008027 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.584706:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.584764:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455791488 00010000:00010000:2.0:1715205776.584781:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050076cd lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23808 expref: 129 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.584807:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4816 00000100:00100000:2.0:1715205776.584811:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f110980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+129:1830:x1798520455791488:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1715205776.584821:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.584825:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050076cd lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23808 expref: 129 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.584833:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050076cd lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23808 expref: 129 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.584850:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050076cd lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23808 expref: 129 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.584860:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:2.0:1715205776.584863:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305008027 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.584870:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305008027 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.584876:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305008027 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.584898:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.584925:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305008027 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.584932:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f110980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:1830:x1798520455791488:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 120us (227us total) trans 0 rc 0/0 00010000:00010000:0.0:1715205776.584937:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305008027 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.584937:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4816 00000004:00200000:0.0:1715205776.584951:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1014:0x0]: returning size 2048 00010000:00010000:0.0:1715205776.585049:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af4305008020 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ba4 expref: 129 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.585060:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305008027 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ba4 expref: 128 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.585066:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:0.0:1715205776.585068:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205776.585069:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fad8d80, rc 0) 00010000:00000080:0.0:1715205776.585073:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f1150c0 x1798520455791424/t330712482713(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.585106:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1150c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:11754:x1798520455791424:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1799us (1890us total) trans 330712482713 rc 0/0 00000100:00100000:0.0:1715205776.585112:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2020 00000100:00100000:1.0:1715205776.586122:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.586158:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455791552 00000100:00100000:0.0:1715205776.586189:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2021 00000100:00100000:0.0:1715205776.586193:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f115580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:11754:x1798520455791552:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.586208:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.586219:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af4305008035 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23bab expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.586256:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af430500803c lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.586265:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305008027 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ba4 expref: 129 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.586270:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af430500803c lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.586290:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305008027 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ba4 expref: 129 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.586299:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305008027 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ba4 expref: 129 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.586308:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009e6fbdc0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456038592:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.586349:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880129e0e900 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.587426:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009e6fbdc0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456038592:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.587440:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af430500803c lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.587750:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.587875:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455791616 00010000:00010000:2.0:1715205776.587895:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305008027 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ba4 expref: 130 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.587913:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4817 00000100:00100000:2.0:1715205776.587917:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f113dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+130:1831:x1798520455791616:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1715205776.587927:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.587930:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305008027 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ba4 expref: 130 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.587943:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305008027 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ba4 expref: 130 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.587958:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af4305008027 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ba4 expref: 130 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.587969:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:2.0:1715205776.587971:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af430500803c lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.587978:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af430500803c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.587983:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af430500803c lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.588220:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205776.588251:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f113dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+129:1831:x1798520455791616:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 333us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.588256:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4817 00010000:00010000:0.0:1715205776.588333:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af430500803c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.588341:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af430500803c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.588370:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1014:0x0]: returning size 2048 00000004:00200000:0.0:1715205776.588372:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205776.588383:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af430500803c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.588391:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af430500803c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.588411:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af4305008035 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bab expref: 129 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.588424:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af430500803c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bab expref: 128 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.588431:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:0.0:1715205776.588433:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205776.588434:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83f180, rc 0) 00010000:00000080:0.0:1715205776.588438:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f115580 x1798520455791552/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.588473:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f115580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:11754:x1798520455791552:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2280us (2352us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.588480:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2021 00000100:00100000:1.0:1715205776.589964:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.590013:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455791680 00000100:00100000:0.0:1715205776.590048:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2022 00000100:00100000:0.0:1715205776.590053:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f115f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:11754:x1798520455791680:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.590068:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.590080:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af4305008043 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23bb2 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.590122:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af430500804a lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.590132:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af430500804a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.590139:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af430500804a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.590148:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305008051 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.590153:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305008051 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.590157:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305008051 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.590235:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af430500804a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.590240:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af430500804a lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.590291:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af430500804a lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.590300:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83fa80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.590303:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af430500804a lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.590308:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af430500804a lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.590315:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.590317:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.590319:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af430500804a lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.590322:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af430500804a lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.590331:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305008051 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.590336:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305008051 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.590340:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305008051 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.590344:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83cfc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.590345:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305008051 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.590350:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305008051 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.590356:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x78ea50f (ffff880091e4c300) 00010000:00010000:0.0:1715205776.590358:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.590359:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305008051 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.590364:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305008051 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.590396:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af4305008043 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bb2 expref: 129 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.590403:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af4305008043 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bb2 expref: 129 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.590410:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83c900, rc 0) 00010000:00000080:0.0:1715205776.590414:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f115f00 x1798520455791680/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.590458:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f115f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:11754:x1798520455791680:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 404us (496us total) trans 0 rc 301/301 00000100:00100000:0.0:1715205776.590465:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2022 00000100:00100000:3.0:1715205776.591656:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.591691:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455791744 00000100:00100000:0.0:1715205776.591780:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2023 00000100:00100000:0.0:1715205776.591785:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ded0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+128:11754:x1798520455791744:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.591794:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.591800:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e1c0/0xb608af4305008058 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23bb9 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.591821:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e1c0/0xb608af4305008058 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bb9 expref: 129 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.591830:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e1c0/0xb608af4305008058 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bb9 expref: 129 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.591835:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.591837:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.591838:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83e1c0, rc 0) 00010000:00000080:0.0:1715205776.591841:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6ded0c0 x1798520455791744/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 328/344 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.591878:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ded0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+129:11754:x1798520455791744:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 93us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.591884:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2023 00000100:00100000:3.0:1715205776.592893:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.592928:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455791808 00000100:00100000:0.0:1715205776.592957:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 542 00000100:00100000:0.0:1715205776.592962:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880093c03850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+129:11754:x1798520455791808:12345-192.168.204.8@tcp:37:dbench.0 00010000:00000080:0.0:1715205776.594785:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880093c03850 x1798520455791808/t0(0) o37->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 448/440 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.594828:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880093c03850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+129:11754:x1798520455791808:12345-192.168.204.8@tcp:37:dbench.0 Request processed in 1866us (1937us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.594835:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 542 00000100:00100000:0.0:1715205776.596326:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.596394:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455791872 00000100:00100000:1.0:1715205776.596446:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2024 00000100:00100000:1.0:1715205776.596451:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fbdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+129:11754:x1798520455791872:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.596467:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.596483:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af430500805f lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23bc0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.596521:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305008066 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.596532:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305008066 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.596541:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305008066 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.596551:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500806d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.596556:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500806d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.596560:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500806d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.596642:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305008066 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.596647:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305008066 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.596652:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305008066 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.596656:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd98d80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.596659:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305008066 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.596664:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305008066 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.596672:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205776.596674:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.596676:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305008066 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.596680:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305008066 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.596689:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500806d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.596694:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500806d lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.596698:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500806d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.596701:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd986c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.596703:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500806d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.596706:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500806d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.596711:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0xec6f74b7 (ffff880129cf6d00) 00010000:00010000:1.0:1715205776.596713:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.596714:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500806d lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.596718:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af430500806d lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.596760:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af430500805f lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bc0 expref: 130 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.596765:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af430500805f lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bc0 expref: 130 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.596771:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9b3c0, rc 0) 00010000:00000080:1.0:1715205776.596775:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6fbdc0 x1798520455791872/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.596825:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fbdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+129:11754:x1798520455791872:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 374us (501us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205776.596831:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2024 00000100:00100000:2.0:1715205776.598004:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.598075:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455791936 00000100:00100000:1.0:1715205776.598108:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2025 00000100:00100000:1.0:1715205776.598111:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+129:11754:x1798520455791936:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.598118:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.598125:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305008074 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23bc7 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.598145:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500807b lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.598155:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500807b lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.598161:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500807b lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.598170:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305008082 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x45484397 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.598174:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305008082 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45484397 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.598179:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305008082 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45484397 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.598208:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500807b lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.598213:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500807b lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.598218:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500807b lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.598232:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd99200 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.598237:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500807b lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.598241:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500807b lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.598248:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205776.598250:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.598251:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500807b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.598255:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500807b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.598263:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305008082 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45484397 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.598267:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305008082 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45484397 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.598271:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305008082 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45484397 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.598275:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd9a880 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.598276:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305008082 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45484397 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.598280:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305008082 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45484397 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.598285:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x45484397 (ffff880129cf6500) 00010000:00010000:1.0:1715205776.598286:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.598287:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305008082 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x45484397 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.598294:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305008082 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x45484397 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.598319:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305008074 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bc7 expref: 130 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.598325:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305008074 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bc7 expref: 130 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.598329:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd998c0, rc 0) 00010000:00000080:1.0:1715205776.598333:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c5580 x1798520455791936/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.598363:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+129:11754:x1798520455791936:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 251us (361us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205776.598368:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2025 00000100:00100000:0.0:1715205776.599371:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.599406:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455792000 00000100:00100000:1.0:1715205776.599434:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2026 00000100:00100000:1.0:1715205776.599438:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e6fe3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+129:11754:x1798520455792000:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.599444:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.599451:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305008089 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23bce expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.599472:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305008090 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.599479:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305008090 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.599485:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305008090 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.599492:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305008097 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x45484397 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.599495:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305008097 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45484397 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.599498:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305008097 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45484397 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.599521:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305008090 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.599523:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305008090 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.599526:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305008090 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.599529:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd98240 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.599530:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305008090 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.599533:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305008090 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.599536:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205776.599537:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.599538:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305008090 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.599541:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af4305008090 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.599546:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305008097 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45484397 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.599548:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305008097 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45484397 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.599551:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305008097 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45484397 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.599555:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd99f80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.599556:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305008097 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45484397 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.599566:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305008097 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x45484397 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.599570:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x45484397 (ffff880129cf6600) 00010000:00010000:1.0:1715205776.599572:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.599573:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305008097 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x45484397 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.599577:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af4305008097 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x45484397 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.599606:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305008089 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bce expref: 130 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.599612:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af4305008089 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bce expref: 130 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.599648:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9bcc0, rc 0) 00010000:00000080:1.0:1715205776.599652:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009e6fe3c0 x1798520455792000/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.599676:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e6fe3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+129:11754:x1798520455792000:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 238us (307us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205776.599681:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2026 00000100:00100000:0.0:1715205776.602413:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.602507:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455792128 00000100:00100000:2.0:1715205776.602547:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 543 00000100:00100000:2.0:1715205776.602552:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801314784c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+129:11754:x1798520455792128:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.602857:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801314784c0 x1798520455792128/t330712482714(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.602896:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801314784c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+130:11754:x1798520455792128:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 343us (487us total) trans 330712482714 rc 0/0 00000100:00100000:2.0:1715205776.602902:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 543 00000100:00100000:0.0:1715205776.604528:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.604598:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455792256 00000100:00100000:1.0:1715205776.604911:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2027 00000100:00100000:1.0:1715205776.604914:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a482140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+130:11754:x1798520455792256:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.604926:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.604938:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af430500809e lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23bd5 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.604984:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050080a5 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.604992:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af4305007ca0 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a3f expref: 131 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.604998:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050080a5 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.605022:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af4305007ca0 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a3f expref: 131 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.605030:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af4305007ca0 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a3f expref: 131 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.605040:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f112f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456038656:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.605106:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a641a180 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.605999:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f112f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456038656:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.606018:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050080a5 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.606694:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.606756:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455792320 00010000:00010000:2.0:1715205776.606775:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af4305007ca0 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a3f expref: 132 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.606960:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4818 00000100:00100000:2.0:1715205776.606965:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a483900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+132:1830:x1798520455792320:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1715205776.606974:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.606978:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af4305007ca0 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a3f expref: 132 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.606986:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af4305007ca0 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a3f expref: 132 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.607000:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af4305007ca0 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a3f expref: 132 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.607009:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1015:0x0].0x0 (ffff88009ee7d600) 00010000:00010000:2.0:1715205776.607012:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050080a5 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.607018:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050080a5 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.607023:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050080a5 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.607051:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205776.607398:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a483900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+131:1830:x1798520455792320:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 432us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.607404:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4818 00010000:00010000:0.0:1715205776.607497:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050080a5 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.607504:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050080a5 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.607518:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1015:0x0]: returning size 4096 00010000:00010000:0.0:1715205776.607613:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af430500809e lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bd5 expref: 132 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.607652:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050080a5 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bd5 expref: 131 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.607658:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1015:0x0].0x0 (ffff88009ee7d600) 00010000:00010000:0.0:1715205776.607660:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205776.607661:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9ad00, rc 0) 00010000:00000080:0.0:1715205776.607665:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009a482140 x1798520455792256/t330712482715(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.607757:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a482140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+131:11754:x1798520455792256:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2841us (3231us total) trans 330712482715 rc 0/0 00000100:00100000:0.0:1715205776.607763:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2027 00000100:00100000:0.0:1715205776.608726:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.608760:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455792384 00000100:00100000:1.0:1715205776.608788:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2028 00000100:00100000:1.0:1715205776.608792:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad3dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+131:11754:x1798520455792384:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.608805:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.608813:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050080b3 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23bdc expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.608845:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050080ba lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.608853:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050080a5 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bd5 expref: 132 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.608858:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050080ba lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.608877:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050080a5 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bd5 expref: 132 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.608885:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050080a5 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bd5 expref: 132 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.608894:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f112f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456038720:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.608927:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a641a180 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.609711:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f112f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456038720:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.609743:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050080ba lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.609850:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.609893:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455792448 00010000:00010000:1.0:1715205776.609907:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050080a5 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bd5 expref: 133 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.609929:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4819 00000100:00100000:1.0:1715205776.609933:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad2600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+133:1831:x1798520455792448:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1715205776.609939:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.609942:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050080a5 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bd5 expref: 133 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.609948:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050080a5 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bd5 expref: 133 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.609958:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050080a5 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bd5 expref: 133 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.609966:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1015:0x0].0x0 (ffff88009ee7d600) 00010000:00010000:1.0:1715205776.609968:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050080ba lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.609974:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050080ba lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.609978:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050080ba lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.609998:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205776.610021:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad2600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+132:1831:x1798520455792448:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 87us (171us total) trans 0 rc 0/0 00010000:00010000:0.0:1715205776.610024:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050080ba lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.610027:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4819 00010000:00010000:0.0:1715205776.610032:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050080ba lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.610055:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1015:0x0]: returning size 4096 00000004:00200000:0.0:1715205776.610058:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205776.610067:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050080ba lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.610074:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050080ba lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.610085:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050080b3 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bdc expref: 132 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.610095:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050080ba lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bdc expref: 131 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.610100:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1015:0x0].0x0 (ffff88009ee7d600) 00010000:00010000:0.0:1715205776.610102:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205776.610103:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9b600, rc 0) 00010000:00000080:0.0:1715205776.610106:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880134ad3dc0 x1798520455792384/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.610134:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad3dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+131:11754:x1798520455792384:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1341us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.610142:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2028 00000100:00100000:2.0:1715205776.612194:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.612251:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455792576 00000100:00100000:3.0:1715205776.612285:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 544 00000100:00100000:3.0:1715205776.612289:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+131:11754:x1798520455792576:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:3.0:1715205776.612393:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c17c0 x1798520455792576/t330712482716(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.612431:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+132:11754:x1798520455792576:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 142us (240us total) trans 330712482716 rc 0/0 00000100:00100000:3.0:1715205776.612438:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 544 00000100:00100000:1.0:1715205776.613817:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.613857:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455792704 00000100:00100000:3.0:1715205776.613885:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 545 00000100:00100000:3.0:1715205776.613889:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1176c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+132:11754:x1798520455792704:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:3.0:1715205776.614026:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f1176c0 x1798520455792704/t330712482717(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.614051:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1176c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+133:11754:x1798520455792704:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 162us (236us total) trans 330712482717 rc 0/0 00000100:00100000:3.0:1715205776.614057:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 545 00000100:00100000:2.0:1715205776.615161:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.615207:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455792832 00000100:00100000:1.0:1715205776.615248:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 546 00000100:00100000:1.0:1715205776.615252:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+133:11754:x1798520455792832:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.615338:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c6880 x1798520455792832/t330712482718(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.615377:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+134:11754:x1798520455792832:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 124us (217us total) trans 330712482718 rc 0/0 00000100:00100000:1.0:1715205776.615382:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 546 00000100:00100000:0.0:1715205776.616103:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.616152:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455792960 00000100:00100000:1.0:1715205776.616177:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 547 00000100:00100000:1.0:1715205776.616181:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+134:11754:x1798520455792960:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.616244:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880134ad1300 x1798520455792960/t330712482719(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.616277:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+135:11754:x1798520455792960:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 95us (175us total) trans 330712482719 rc 0/0 00000100:00100000:1.0:1715205776.616283:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 547 00000100:00100000:0.0:1715205776.616867:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.617037:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455793088 00000100:00100000:1.0:1715205776.617054:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 548 00000100:00100000:1.0:1715205776.617057:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f251850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+135:11754:x1798520455793088:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.617121:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009f251850 x1798520455793088/t330712482720(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.617146:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f251850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+136:11754:x1798520455793088:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 89us (280us total) trans 330712482720 rc 0/0 00000100:00100000:1.0:1715205776.617151:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 548 00000100:00100000:2.0:1715205776.617834:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.617896:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455793216 00000100:00100000:1.0:1715205776.617913:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 549 00000100:00100000:1.0:1715205776.617916:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+136:11754:x1798520455793216:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.617972:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c2140 x1798520455793216/t330712482721(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.617996:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+137:11754:x1798520455793216:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 79us (164us total) trans 330712482721 rc 0/0 00000100:00100000:1.0:1715205776.618001:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 549 00000100:00100000:2.0:1715205776.619378:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.619436:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455793344 00000100:00100000:1.0:1715205776.619455:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 550 00000100:00100000:1.0:1715205776.619458:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+137:11754:x1798520455793344:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.619533:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c5a40 x1798520455793344/t330712482722(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.619571:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+138:11754:x1798520455793344:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 111us (195us total) trans 330712482722 rc 0/0 00000100:00100000:1.0:1715205776.619577:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 550 00000100:00100000:2.0:1715205776.620452:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.620783:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455793472 00000100:00100000:1.0:1715205776.620814:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 551 00000100:00100000:1.0:1715205776.620818:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+138:11754:x1798520455793472:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.620891:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c4280 x1798520455793472/t330712482723(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.621051:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+139:11754:x1798520455793472:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 231us (598us total) trans 330712482723 rc 0/0 00000100:00100000:1.0:1715205776.621061:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 551 00000100:00100000:3.0:1715205776.622109:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.622177:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455793600 00000100:00100000:1.0:1715205776.622203:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 552 00000100:00100000:1.0:1715205776.622206:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6debdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+139:11754:x1798520455793600:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.622270:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6debdc0 x1798520455793600/t330712482724(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.622291:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6debdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+140:11754:x1798520455793600:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 84us (184us total) trans 330712482724 rc 0/0 00000100:00100000:1.0:1715205776.622296:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 552 00000100:00100000:0.0:1715205776.623098:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.623166:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455793728 00000100:00100000:2.0:1715205776.623194:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 553 00000100:00100000:2.0:1715205776.623198:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad3440 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+140:11754:x1798520455793728:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.623576:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880134ad3440 x1798520455793728/t330712482725(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.623611:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad3440 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+141:11754:x1798520455793728:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 413us (515us total) trans 330712482725 rc 0/0 00000100:00100000:2.0:1715205776.623639:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 553 00000100:00100000:3.0:1715205776.624657:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.624718:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455793856 00000100:00100000:2.0:1715205776.624769:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 554 00000100:00100000:2.0:1715205776.624772:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f254850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+141:11754:x1798520455793856:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.624840:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009f254850 x1798520455793856/t330712482726(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.624863:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f254850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+142:11754:x1798520455793856:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 91us (209us total) trans 330712482726 rc 0/0 00000100:00100000:2.0:1715205776.624869:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 554 00000100:00100000:3.0:1715205776.625666:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.625723:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455793984 00000100:00100000:0.0:1715205776.625759:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 555 00000100:00100000:0.0:1715205776.625763:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6deb900 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+142:11754:x1798520455793984:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:0.0:1715205776.625828:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6deb900 x1798520455793984/t330712482727(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.625948:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6deb900 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+143:11754:x1798520455793984:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 184us (282us total) trans 330712482727 rc 0/0 00000100:00100000:0.0:1715205776.625953:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 555 00000100:00100000:0.0:1715205776.627307:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.627360:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455794112 00000100:00100000:2.0:1715205776.627391:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 556 00000100:00100000:2.0:1715205776.627395:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+143:11754:x1798520455794112:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.627467:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880134ad7200 x1798520455794112/t330712482728(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.627496:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+144:11754:x1798520455794112:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 101us (191us total) trans 330712482728 rc 0/0 00000100:00100000:2.0:1715205776.627501:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 556 00000100:00100000:3.0:1715205776.629582:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.629636:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455794240 00000100:00100000:2.0:1715205776.629669:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 557 00000100:00100000:2.0:1715205776.629674:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6def6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+144:11754:x1798520455794240:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.629770:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6def6c0 x1798520455794240/t330712482729(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.629796:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6def6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+145:11754:x1798520455794240:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 123us (217us total) trans 330712482729 rc 0/0 00000100:00100000:2.0:1715205776.629803:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 557 00000100:00100000:3.0:1715205776.631102:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.631173:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455794368 00000100:00100000:2.0:1715205776.631196:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 558 00000100:00100000:2.0:1715205776.631200:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6deed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+145:11754:x1798520455794368:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.631263:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6deed40 x1798520455794368/t330712482730(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.631290:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6deed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+146:11754:x1798520455794368:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 90us (190us total) trans 330712482730 rc 0/0 00000100:00100000:2.0:1715205776.631295:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 558 00000100:00100000:2.0:1715205776.632014:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.632074:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455794496 00000100:00100000:3.0:1715205776.632095:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 559 00000100:00100000:3.0:1715205776.632098:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+146:11754:x1798520455794496:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:3.0:1715205776.632160:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c2140 x1798520455794496/t330712482731(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.632189:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+147:11754:x1798520455794496:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 91us (177us total) trans 330712482731 rc 0/0 00000100:00100000:3.0:1715205776.632195:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 559 00000100:00100000:3.0:1715205776.632953:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.632966:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455794624 00000100:00100000:3.0:1715205776.632985:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 560 00000100:00100000:3.0:1715205776.632988:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f252050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+147:11754:x1798520455794624:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:3.0:1715205776.633044:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009f252050 x1798520455794624/t330712482732(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.633063:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f252050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+148:11754:x1798520455794624:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 75us (111us total) trans 330712482732 rc 0/0 00000100:00100000:3.0:1715205776.633068:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 560 00000100:00100000:2.0:1715205776.634447:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.634466:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455794752 00000100:00100000:3.0:1715205776.634484:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 561 00000100:00100000:3.0:1715205776.634488:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+148:11754:x1798520455794752:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:3.0:1715205776.634558:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c5a40 x1798520455794752/t330712482733(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.634584:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+149:11754:x1798520455794752:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 95us (139us total) trans 330712482733 rc 0/0 00000100:00100000:3.0:1715205776.634589:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 561 00000100:00100000:2.0:1715205776.635469:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.635503:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455794880 00000100:00100000:3.0:1715205776.635520:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 562 00000100:00100000:3.0:1715205776.635523:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+149:11754:x1798520455794880:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:3.0:1715205776.635585:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c4280 x1798520455794880/t330712482734(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.635615:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+150:11754:x1798520455794880:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 91us (147us total) trans 330712482734 rc 0/0 00000100:00100000:3.0:1715205776.635636:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 562 00000100:00100000:3.0:1715205776.636355:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.636495:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455795008 00000100:00100000:2.0:1715205776.636521:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 563 00000100:00100000:2.0:1715205776.636525:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6deb900 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+150:11754:x1798520455795008:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.636591:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6deb900 x1798520455795008/t330712482735(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.636643:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6deb900 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:11754:x1798520455795008:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 118us (289us total) trans 330712482735 rc 0/0 00000100:00100000:2.0:1715205776.636649:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 563 00000100:00100000:3.0:1715205776.638241:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.638262:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455795136 00000100:00100000:0.0:1715205776.638291:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2029 00000100:00100000:0.0:1715205776.638294:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6def6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:11754:x1798520455795136:12345-192.168.204.8@tcp:36:dbench.0 00010000:00010000:0.0:1715205776.638319:0:14860:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1715205776.638335:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050080ba lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bdc expref: 151 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.638347:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83ed00/0xb608af4305007c37 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a0e expref: 150 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.638355:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1015:0x0].0x0 (ffff88009ee7d600) 00010000:00010000:0.0:1715205776.638368:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e1c0/0xb608af4305008058 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bb9 expref: 149 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.638379:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.638381:0:14860:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.638397:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af43050080c1 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.638406:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af43050080c1 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.638413:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af43050080c1 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.638421:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af43050080c8 lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.638426:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af43050080c8 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.638430:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af43050080c8 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.638512:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af43050080cf lrc: 3/0,1 mode: --/EX res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.638517:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af43050080cf lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.638522:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af43050080cf lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1715205776.638888:0:14860:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x134:0x0].75, 64 off12992 00000004:00080000:0.0:1715205776.638894:0:14860:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3036578275182ns, next at 3037578273713ns, rc = 0 00010000:00010000:0.0:1715205776.638932:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af43050080d6 lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.638938:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af43050080d6 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.638944:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af43050080d6 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.638949:0:14860:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af43050080d6 lrc: 4/0,1 mode: PW/PW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.638954:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af43050080d6 lrc: 4/0,1 mode: PW/PW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.638959:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af43050080d6 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.638982:0:14860:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1715205776.638994:0:14860:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff8800a6def6c0 reply state ffff8800a049b000 transno 330712482736 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af43050080cf lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.639024:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af43050080c1 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.639029:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af43050080c1 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.639034:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af43050080c1 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.639039:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83c900 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.639041:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af43050080c1 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.639046:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af43050080c1 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.639052:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.639053:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.639055:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af43050080c1 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.639059:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af43050080c1 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715205776.639064:0:14860:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff8800a6def6c0 reply state ffff8800a049b000 transno 330712482736 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af43050080c8 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00000080:0.0:1715205776.639075:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6def6c0 x1798520455795136/t330712482736(0) o36->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 504/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.639117:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6def6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+150:11754:x1798520455795136:12345-192.168.204.8@tcp:36:dbench.0 Request processed in 822us (878us total) trans 330712482736 rc 0/0 00000100:00100000:0.0:1715205776.639122:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2029 00010000:00010000:1.0:1715205776.639485:0:6664:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715205776.639489:0:6664:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af43050080d6 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.639494:0:6664:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83df80 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:1.0:1715205776.639495:0:6664:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af43050080d6 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.639504:0:6664:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af43050080d6 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.639510:0:6664:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1015:0x0].0x0 (ffff880091e4c300) 00010000:00010000:1.0:1715205776.639512:0:6664:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1715205776.639513:0:6664:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af43050080d6 lrc: 1/0,0 mode: --/PW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.639517:0:6664:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af43050080d6 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.639524:0:6664:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205776.639525:0:6664:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205776.639525:0:6664:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715205776.641539:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.641614:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455795264 00000100:00100000:2.0:1715205776.641654:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 564 00000100:00100000:2.0:1715205776.641658:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6deed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+150:11754:x1798520455795264:12345-192.168.204.8@tcp:35:dbench.0 00010000:00010000:1.0:1715205776.641764:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af43050080c8 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.641772:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af43050080c8 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.641778:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af43050080c8 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.641782:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83cfc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.641785:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af43050080c8 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.641789:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af43050080c8 lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.641797:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x63bf9fee (ffff880091e4c800) 00010000:00010000:1.0:1715205776.641799:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.641801:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af43050080c8 lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.641805:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af43050080c8 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.641814:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af43050080cf lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.641818:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af43050080cf lrc: 2/0,0 mode: EX/EX res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.641822:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af43050080cf lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.641825:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83fa80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.641827:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af43050080cf lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.641831:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af43050080cf lrc: 4/0,0 mode: EX/EX res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00000080:2.0:1715205776.641833:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6deed40 x1798520455795264/t330712482737(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00010000:00010000:1.0:1715205776.641836:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1015:0x0].0x0 (ffff880091e4c300) 00010000:00010000:1.0:1715205776.641838:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715205776.641839:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af43050080cf lrc: 2/0,0 mode: --/EX res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.641847:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af43050080cf lrc: 0/0,0 mode: --/EX res: [0x20001b1b3:0x1015:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.641872:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6deed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+150:11754:x1798520455795264:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 214us (335us total) trans 330712482737 rc 0/0 00000100:00100000:2.0:1715205776.641878:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 564 00000100:00100000:3.0:1715205776.643261:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.643295:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455795392 00000100:00100000:0.0:1715205776.643330:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2030 00000100:00100000:0.0:1715205776.643334:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6debdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+150:11754:x1798520455795392:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.643343:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.643354:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af43050080dd lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23be3 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.643397:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af43050080e4 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.643406:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007ed0 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b18 expref: 151 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.643411:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af43050080e4 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.643434:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007ed0 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b18 expref: 151 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.643442:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007ed0 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b18 expref: 151 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.643452:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880134ad2f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456038784:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.643488:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880129e0ef00 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.644888:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880134ad2f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456038784:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.644902:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af43050080e4 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.644909:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.644963:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455795456 00010000:00010000:1.0:1715205776.644977:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007ed0 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b18 expref: 152 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.645008:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4820 00000100:00100000:1.0:1715205776.645012:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+152:1831:x1798520455795456:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1715205776.645020:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.645023:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007ed0 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b18 expref: 152 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.645030:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007ed0 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b18 expref: 152 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.645042:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305007ed0 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b18 expref: 152 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.645051:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1016:0x0].0x0 (ffff8800b7b20f00) 00010000:00010000:1.0:1715205776.645053:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af43050080e4 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.645059:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af43050080e4 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.645064:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af43050080e4 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.645090:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205776.645121:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129eb8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:1831:x1798520455795456:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 108us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.645126:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4820 00010000:00010000:0.0:1715205776.645195:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af43050080e4 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.645201:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af43050080e4 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.645212:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1016:0x0]: returning size 4096 00010000:00010000:0.0:1715205776.645303:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af43050080dd lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23be3 expref: 152 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.645313:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af43050080e4 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23be3 expref: 151 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.645317:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1016:0x0].0x0 (ffff8800b7b20f00) 00010000:00010000:0.0:1715205776.645319:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205776.645321:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83fcc0, rc 0) 00010000:00000080:0.0:1715205776.645324:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6debdc0 x1798520455795392/t330712482738(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.645346:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6debdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:11754:x1798520455795392:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2011us (2086us total) trans 330712482738 rc 0/0 00000100:00100000:0.0:1715205776.645351:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2030 00000100:00100000:3.0:1715205776.646396:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.646460:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455795520 00000100:00100000:0.0:1715205776.646508:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2031 00000100:00100000:0.0:1715205776.646513:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6def200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:11754:x1798520455795520:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.646534:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.646547:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af43050080f2 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23bea expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.646591:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af43050080f9 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.646604:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af43050080e4 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23be3 expref: 152 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.646609:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af43050080f9 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.646665:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af43050080e4 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23be3 expref: 152 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.646674:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af43050080e4 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23be3 expref: 152 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.646683:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880134ad2f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456038848:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.646747:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880129e0ef00 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.647686:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880134ad2f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456038848:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.647701:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af43050080f9 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.647708:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.647770:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455795584 00010000:00010000:2.0:1715205776.647791:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af43050080e4 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23be3 expref: 153 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.647817:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4821 00000100:00100000:2.0:1715205776.647821:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6dec740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:1830:x1798520455795584:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1715205776.647828:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.647832:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af43050080e4 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23be3 expref: 153 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.647839:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af43050080e4 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23be3 expref: 153 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.647852:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af43050080e4 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23be3 expref: 153 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.647864:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1016:0x0].0x0 (ffff8800b7b20f00) 00010000:00010000:2.0:1715205776.647867:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af43050080f9 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.647873:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af43050080f9 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.647878:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af43050080f9 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.647905:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205776.647932:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6dec740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+152:1830:x1798520455795584:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 111us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.647938:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4821 00010000:00010000:0.0:1715205776.647944:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af43050080f9 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.647952:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af43050080f9 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.648058:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1016:0x0]: returning size 4096 00000004:00200000:0.0:1715205776.648061:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205776.648071:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af43050080f9 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.648080:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af43050080f9 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.648099:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af43050080f2 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bea expref: 152 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.648111:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af43050080f9 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bea expref: 151 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.648118:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1016:0x0].0x0 (ffff8800b7b20f00) 00010000:00010000:0.0:1715205776.648120:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205776.648121:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83f840, rc 0) 00010000:00000080:0.0:1715205776.648126:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6def200 x1798520455795520/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.648165:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6def200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:11754:x1798520455795520:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1652us (1770us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.648172:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2031 00000100:00100000:3.0:1715205776.649676:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.649778:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455795712 00000100:00100000:2.0:1715205776.649817:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 565 00000100:00100000:2.0:1715205776.649821:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+151:11754:x1798520455795712:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.650140:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb3900 x1798520455795712/t330712482739(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.650177:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+152:11754:x1798520455795712:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 355us (502us total) trans 330712482739 rc 0/0 00000100:00100000:2.0:1715205776.650184:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 565 00000100:00100000:3.0:1715205776.651422:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.651465:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455795840 00000100:00100000:0.0:1715205776.651501:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2032 00000100:00100000:0.0:1715205776.651505:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+152:11754:x1798520455795840:12345-192.168.204.8@tcp:36:dbench.0 00010000:00010000:0.0:1715205776.651535:0:14860:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1715205776.651553:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af43050080f9 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bea expref: 152 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.651570:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305007e67 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ae7 expref: 151 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.651583:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1016:0x0].0x0 (ffff8800b7b20f00) 00010000:00010000:0.0:1715205776.651592:0:14860:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.651612:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008100 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.651643:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008100 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.651650:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008100 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.651661:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305008107 lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.651666:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305008107 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.651671:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305008107 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.651788:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500810e lrc: 3/0,1 mode: --/EX res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.651795:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500810e lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.651800:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500810e lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1715205776.652121:0:14860:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x136:0x0].68, 64 off12544 00000004:00080000:0.0:1715205776.652127:0:14860:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3036591507933ns, next at 3037591506110ns, rc = 0 00010000:00010000:0.0:1715205776.652170:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305008115 lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.652176:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305008115 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.652182:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305008115 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.652188:0:14860:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305008115 lrc: 4/0,1 mode: PW/PW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.652193:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305008115 lrc: 4/0,1 mode: PW/PW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.652197:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305008115 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.652224:0:14860:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1715205776.652237:0:14860:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88009edb2140 reply state ffff8800a049a000 transno 330712482740 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500810e lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.652278:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008100 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.652282:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008100 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.652284:0:11161:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1715205776.652287:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008100 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.652293:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83d8c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.652293:0:11161:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305008115 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.652296:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008100 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.652302:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008100 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.652303:0:11161:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83e880 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:1.0:1715205776.652305:0:11161:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305008115 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.652310:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.652311:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.652312:0:11161:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305008115 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.652314:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008100 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.652318:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008100 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715205776.652325:0:14860:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88009edb2140 reply state ffff8800a049a000 transno 330712482740 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305008107 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.652326:0:11161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1016:0x0].0x0 (ffff880091e4c600) 00010000:00010000:1.0:1715205776.652328:0:11161:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1715205776.652330:0:11161:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305008115 lrc: 1/0,0 mode: --/PW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.652334:0:11161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305008115 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00000080:0.0:1715205776.652338:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb2140 x1798520455795840/t330712482740(0) o36->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 496/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00010000:00010000:1.0:1715205776.652346:0:11161:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205776.652346:0:11161:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205776.652347:0:11161:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1715205776.652389:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+152:11754:x1798520455795840:12345-192.168.204.8@tcp:36:dbench.0 Request processed in 884us (968us total) trans 330712482740 rc 0/0 00000100:00100000:0.0:1715205776.652396:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2032 00000100:00100000:3.0:1715205776.654569:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:0.0:1715205776.654649:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305008107 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.654653:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455795968 00010000:00010000:0.0:1715205776.654658:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305008107 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.654663:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305008107 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.654668:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83e400 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.654671:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305008107 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.654675:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305008107 lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.654684:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x6c9b575e (ffff880091e4c500) 00010000:00010000:0.0:1715205776.654686:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.654688:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305008107 lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.654691:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305008107 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.654702:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 566 00010000:00010000:0.0:1715205776.654705:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500810e lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.654706:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f257850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+152:11754:x1798520455795968:12345-192.168.204.8@tcp:35:dbench.0 00010000:00010000:0.0:1715205776.654710:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500810e lrc: 2/0,0 mode: EX/EX res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.654714:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500810e lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.654722:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83db00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.654723:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500810e lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.654738:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500810e lrc: 4/0,0 mode: EX/EX res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.654745:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1016:0x0].0x0 (ffff880091e4c600) 00010000:00010000:0.0:1715205776.654746:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1715205776.654747:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500810e lrc: 2/0,0 mode: --/EX res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.654750:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500810e lrc: 0/0,0 mode: --/EX res: [0x20001b1b3:0x1016:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00000080:2.0:1715205776.654944:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009f257850 x1798520455795968/t330712482741(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.654991:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f257850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+152:11754:x1798520455795968:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 285us (425us total) trans 330712482741 rc 0/0 00000100:00100000:2.0:1715205776.654998:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 566 00000100:00100000:3.0:1715205776.656668:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.656705:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455796096 00000100:00100000:0.0:1715205776.656750:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2033 00000100:00100000:0.0:1715205776.656755:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009edb3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+152:11754:x1798520455796096:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.656771:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.656783:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af430500811c lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23bf1 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.656845:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305008123 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.656853:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305008004 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b96 expref: 153 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.656860:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305008123 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.656880:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305008004 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b96 expref: 153 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.656886:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305008004 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b96 expref: 153 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.656893:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880134ad2f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456038912:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.656935:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880129e0e6c0 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.658219:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.658245:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880134ad2f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456038912:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.658263:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305008123 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.658287:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455796160 00010000:00010000:2.0:1715205776.658307:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305008004 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b96 expref: 154 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.658330:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4822 00000100:00100000:2.0:1715205776.658333:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66d8980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+154:1831:x1798520455796160:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1715205776.658340:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.658343:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305008004 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b96 expref: 154 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.658349:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305008004 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b96 expref: 154 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.658364:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af4305008004 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b96 expref: 154 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.658377:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1017:0x0].0x0 (ffff8800b7b20200) 00010000:00010000:2.0:1715205776.658380:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305008123 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.658385:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305008123 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.658389:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305008123 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.658410:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.658430:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305008123 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.658436:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305008123 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.658446:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66d8980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:1831:x1798520455796160:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 112us (230us total) trans 0 rc 0/0 00000004:00200000:0.0:1715205776.658447:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1017:0x0]: returning size 4096 00000100:00100000:2.0:1715205776.658451:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4822 00010000:00010000:0.0:1715205776.658539:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af430500811c lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bf1 expref: 154 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.658549:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305008123 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bf1 expref: 153 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.658558:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1017:0x0].0x0 (ffff8800b7b20200) 00010000:00010000:0.0:1715205776.658560:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205776.658562:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83f3c0, rc 0) 00010000:00000080:0.0:1715205776.658565:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009edb3900 x1798520455796096/t330712482742(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.658593:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009edb3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:11754:x1798520455796096:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1838us (1927us total) trans 330712482742 rc 0/0 00000100:00100000:0.0:1715205776.658599:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2033 00000100:00100000:3.0:1715205776.659810:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.659862:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455796224 00000100:00100000:0.0:1715205776.659890:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2034 00000100:00100000:0.0:1715205776.659895:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1815a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:11754:x1798520455796224:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.659907:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.659916:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305008131 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23bf8 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.659942:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008138 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.659950:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305008123 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bf1 expref: 154 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.659955:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008138 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.659971:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305008123 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bf1 expref: 154 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.659983:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305008123 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bf1 expref: 154 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.659992:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880134ad2f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456038976:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.660024:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880129e0e6c0 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.660749:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880134ad2f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456038976:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.660769:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008138 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.661209:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.661282:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455796288 00010000:00010000:2.0:1715205776.661297:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305008123 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bf1 expref: 155 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.661323:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4823 00000100:00100000:2.0:1715205776.661326:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a1814740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+155:1831:x1798520455796288:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1715205776.661334:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.661337:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305008123 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bf1 expref: 155 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.661344:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305008123 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bf1 expref: 155 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.661355:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305008123 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bf1 expref: 155 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.661369:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1017:0x0].0x0 (ffff8800b7b20200) 00010000:00010000:2.0:1715205776.661371:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008138 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.661377:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008138 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.661382:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008138 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.661403:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.661420:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008138 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.661425:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008138 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.661427:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1814740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+154:1831:x1798520455796288:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 100us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.661432:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4823 00000004:00200000:0.0:1715205776.661444:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1017:0x0]: returning size 4096 00000004:00200000:0.0:1715205776.661446:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205776.661453:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008138 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.661459:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008138 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.661469:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af4305008131 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bf8 expref: 154 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.661475:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008138 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bf8 expref: 153 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.661479:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1017:0x0].0x0 (ffff8800b7b20200) 00010000:00010000:0.0:1715205776.661480:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205776.661481:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83c480, rc 0) 00010000:00000080:0.0:1715205776.661483:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a1815a40 x1798520455796224/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.661501:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a1815a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:11754:x1798520455796224:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1606us (1693us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.661504:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2034 00000100:00100000:3.0:1715205776.662597:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.662660:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455796416 00000100:00100000:2.0:1715205776.662685:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 567 00000100:00100000:2.0:1715205776.662688:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372ff6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:11754:x1798520455796416:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.662797:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801372ff6c0 x1798520455796416/t330712482743(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.662831:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372ff6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+154:11754:x1798520455796416:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 141us (235us total) trans 330712482743 rc 0/0 00000100:00100000:2.0:1715205776.662836:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 567 00000100:00100000:3.0:1715205776.663970:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.664034:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455796544 00000100:00100000:0.0:1715205776.664083:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2035 00000100:00100000:0.0:1715205776.664088:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372fa600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+154:11754:x1798520455796544:12345-192.168.204.8@tcp:36:dbench.0 00010000:00010000:0.0:1715205776.664126:0:14860:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1715205776.664144:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008138 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bf8 expref: 154 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.664160:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305007f9b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b65 expref: 153 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.664168:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1017:0x0].0x0 (ffff8800b7b20200) 00010000:00010000:0.0:1715205776.664175:0:14860:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.664197:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af430500813f lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.664206:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af430500813f lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.664216:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af430500813f lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.664226:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008146 lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.664231:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008146 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.664236:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008146 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.664346:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af430500814d lrc: 3/0,1 mode: --/EX res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.664352:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af430500814d lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.664357:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af430500814d lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1715205776.664689:0:14860:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x134:0x0].76, 64 off13056 00010000:00010000:0.0:1715205776.664749:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e1c0/0xb608af4305008154 lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.664756:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e1c0/0xb608af4305008154 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.664762:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e1c0/0xb608af4305008154 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.664768:0:14860:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e1c0/0xb608af4305008154 lrc: 4/0,1 mode: PW/PW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.664773:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e1c0/0xb608af4305008154 lrc: 4/0,1 mode: PW/PW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.664777:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e1c0/0xb608af4305008154 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.664797:0:14860:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1715205776.664810:0:14860:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff8801372fa600 reply state ffff8800a7143000 transno 330712482744 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af430500814d lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.664828:0:6569:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715205776.664832:0:6569:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e1c0/0xb608af4305008154 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.664841:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af430500813f lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.664844:0:6569:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83e1c0 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:0.0:1715205776.664846:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af430500813f lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.664848:0:6569:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e1c0/0xb608af4305008154 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.664850:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af430500813f lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.664854:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83cb40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.664854:0:6569:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e1c0/0xb608af4305008154 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.664857:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af430500813f lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.664862:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af430500813f lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.664863:0:6569:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1017:0x0].0x0 (ffff880091e4c800) 00010000:00010000:2.0:1715205776.664865:0:6569:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715205776.664867:0:6569:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e1c0/0xb608af4305008154 lrc: 1/0,0 mode: --/PW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.664871:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.664871:0:6569:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e1c0/0xb608af4305008154 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612134800702224 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.664873:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.664874:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af430500813f lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.664879:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af430500813f lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.664881:0:6569:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715205776.664882:0:6569:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715205776.664883:0:6569:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:0.0:1715205776.664885:0:14860:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff8801372fa600 reply state ffff8800a7143000 transno 330712482744 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008146 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00000080:0.0:1715205776.664899:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801372fa600 x1798520455796544/t330712482744(0) o36->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 496/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.664948:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372fa600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+154:11754:x1798520455796544:12345-192.168.204.8@tcp:36:dbench.0 Request processed in 860us (979us total) trans 330712482744 rc 0/0 00000100:00100000:0.0:1715205776.664953:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2035 00010000:00010000:1.0:1715205776.665580:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008146 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.665594:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008146 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.665600:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008146 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.665605:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83dd40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.665608:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008146 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.665613:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008146 lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.665647:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x6cad4e9d (ffff880091e4c300) 00010000:00010000:1.0:1715205776.665649:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.665651:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008146 lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.665655:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008146 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.665669:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af430500814d lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.665673:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af430500814d lrc: 2/0,0 mode: EX/EX res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.665677:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af430500814d lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.665684:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83c900 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.665685:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af430500814d lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.665689:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af430500814d lrc: 4/0,0 mode: EX/EX res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.665701:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1017:0x0].0x0 (ffff880091e4c800) 00010000:00010000:1.0:1715205776.665703:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1715205776.665704:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af430500814d lrc: 2/0,0 mode: --/EX res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.665709:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af430500814d lrc: 0/0,0 mode: --/EX res: [0x20001b1b3:0x1017:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.665865:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.665901:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455796608 00000100:00100000:0.0:1715205776.665929:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2036 00000100:00100000:0.0:1715205776.665934:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372faac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:11754:x1798520455796608:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.665947:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.665955:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af430500815b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23bff expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.665983:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83ed00/0xb608af4305008162 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.665990:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83ed00/0xb608af4305008162 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.665996:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83ed00/0xb608af4305008162 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.666005:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008169 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.666010:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008169 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.666015:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008169 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.666045:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83ed00/0xb608af4305008162 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.666049:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83ed00/0xb608af4305008162 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.666054:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83ed00/0xb608af4305008162 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.666058:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83ed00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.666060:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83ed00/0xb608af4305008162 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.666064:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83ed00/0xb608af4305008162 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.666069:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.666072:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.666074:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83ed00/0xb608af4305008162 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.666078:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83ed00/0xb608af4305008162 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.666085:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008169 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.666089:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008169 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.666094:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008169 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.666098:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83fa80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.666099:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008169 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.666103:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008169 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.666108:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x52a89496 (ffff880091e4c700) 00010000:00010000:0.0:1715205776.666110:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.666111:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008169 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.666115:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008169 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.666144:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af430500815b lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bff expref: 154 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.666150:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af430500815b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bff expref: 154 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.666156:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83fcc0, rc 0) 00010000:00000080:0.0:1715205776.666159:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801372faac0 x1798520455796608/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.666190:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372faac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:11754:x1798520455796608:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 256us (328us total) trans 0 rc 301/301 00000100:00100000:0.0:1715205776.666196:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2036 00000100:00100000:3.0:1715205776.667048:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.667121:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455796672 00000100:00100000:0.0:1715205776.667160:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2037 00000100:00100000:0.0:1715205776.667164:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372fe880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+153:11754:x1798520455796672:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.667174:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.667183:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305008170 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23c06 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.667200:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305008170 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c06 expref: 154 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.667206:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305008170 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c06 expref: 154 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.667210:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.667211:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.667212:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83cfc0, rc 0) 00010000:00000080:0.0:1715205776.667215:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801372fe880 x1798520455796672/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 328/344 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.667261:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372fe880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+154:11754:x1798520455796672:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 96us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.667267:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2037 00000100:00100000:3.0:1715205776.668543:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.668612:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455796736 00000100:00100000:2.0:1715205776.668660:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 568 00000100:00100000:2.0:1715205776.668665:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372ff200 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+154:11754:x1798520455796736:12345-192.168.204.8@tcp:37:dbench.0 00010000:00000080:2.0:1715205776.670984:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801372ff200 x1798520455796736/t0(0) o37->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 448/440 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.671031:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372ff200 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+154:11754:x1798520455796736:12345-192.168.204.8@tcp:37:dbench.0 Request processed in 2365us (2490us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.671039:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 568 00000100:00100000:3.0:1715205776.672927:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.672969:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455796864 00000100:00100000:0.0:1715205776.673017:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2038 00000100:00100000:0.0:1715205776.673022:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801372faf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+154:11754:x1798520455796864:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.673041:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.673058:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af4305008177 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23c0d expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.673148:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500817e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.673163:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305007d17 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a70 expref: 155 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.673168:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500817e lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.673197:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305007d17 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a70 expref: 155 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.673206:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305007d17 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a70 expref: 155 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.673221:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880134ad2f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039040:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.673275:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880129e0e540 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.674277:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880134ad2f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039040:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.674302:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500817e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.674312:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.674367:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455796928 00010000:00010000:2.0:1715205776.674388:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305007d17 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a70 expref: 156 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.674423:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4824 00000100:00100000:2.0:1715205776.674427:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092749c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:1830:x1798520455796928:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1715205776.674438:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.674442:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305007d17 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a70 expref: 156 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.674451:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305007d17 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a70 expref: 156 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.674467:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305007d17 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a70 expref: 156 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.674476:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee0:0x0].0x0 (ffff88012d4a6d00) 00010000:00010000:2.0:1715205776.674479:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500817e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.674486:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500817e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.674491:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500817e lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.674512:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.674537:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500817e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.674544:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500817e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.674544:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092749c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+155:1830:x1798520455796928:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 116us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.674552:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4824 00000004:00200000:0.0:1715205776.674565:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee0:0x0]: returning size 260096 00010000:00010000:0.0:1715205776.674708:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af4305008177 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c0d expref: 156 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.674720:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500817e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c0d expref: 155 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.674725:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee0:0x0].0x0 (ffff88012d4a6d00) 00010000:00010000:0.0:1715205776.674726:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205776.674742:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83db00, rc 0) 00010000:00000080:0.0:1715205776.674747:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801372faf80 x1798520455796864/t330712482745(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.674783:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801372faf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+155:11754:x1798520455796864:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1761us (1859us total) trans 330712482745 rc 0/0 00000100:00100000:0.0:1715205776.674793:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2038 00000100:00100000:3.0:1715205776.676347:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.676366:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455796992 00000100:00100000:0.0:1715205776.676448:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2039 00000100:00100000:0.0:1715205776.676453:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092749300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+155:11754:x1798520455796992:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.676466:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.676475:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af430500818c lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23c14 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.676505:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008193 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.676513:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500817e lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c0d expref: 156 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.676518:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008193 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.676537:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500817e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c0d expref: 156 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.676546:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500817e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c0d expref: 156 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.676555:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880134ad2f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039104:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.676593:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880129e0e540 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.677376:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880134ad2f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039104:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.677387:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008193 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.677779:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.677815:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455797056 00010000:00010000:2.0:1715205776.677826:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500817e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c0d expref: 157 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.677846:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4825 00000100:00100000:2.0:1715205776.677849:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009274cc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+157:1831:x1798520455797056:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1715205776.677855:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.677857:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500817e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c0d expref: 157 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.677863:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500817e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c0d expref: 157 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.677871:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af430500817e lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c0d expref: 157 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.677878:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee0:0x0].0x0 (ffff88012d4a6d00) 00010000:00010000:2.0:1715205776.677880:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008193 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.677885:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008193 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.677889:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008193 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.677907:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205776.677927:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009274cc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:1831:x1798520455797056:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 77us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.677932:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4825 00010000:00010000:0.0:1715205776.677979:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008193 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.677985:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008193 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.678006:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee0:0x0]: returning size 260096 00000004:00200000:0.0:1715205776.678009:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205776.678041:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008193 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.678048:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008193 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.678061:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af430500818c lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c14 expref: 156 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.678071:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008193 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c14 expref: 155 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.678076:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee0:0x0].0x0 (ffff88012d4a6d00) 00010000:00010000:0.0:1715205776.678078:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205776.678079:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83d8c0, rc 0) 00010000:00000080:0.0:1715205776.678082:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880092749300 x1798520455796992/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.678107:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092749300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+155:11754:x1798520455796992:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1654us (1762us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.678111:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2039 00000100:00100000:3.0:1715205776.679390:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.679446:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455797120 00000100:00100000:0.0:1715205776.679489:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2040 00000100:00100000:0.0:1715205776.679494:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009274b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+155:11754:x1798520455797120:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.679507:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.679518:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af430500819a lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23c1b expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.679554:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af43050081a1 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.679563:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af43050081a1 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.679568:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af43050081a1 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.679577:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af43050081a8 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.679580:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af43050081a8 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.679583:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af43050081a8 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.679673:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af43050081a1 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.679676:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af43050081a1 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.679682:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af43050081a1 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.679686:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83f840 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.679688:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af43050081a1 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.679692:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af43050081a1 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.679698:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.679699:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.679700:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af43050081a1 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.679703:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af43050081a1 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.679710:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af43050081a8 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.679712:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af43050081a8 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.679715:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af43050081a8 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.679717:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83c900 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.679718:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af43050081a8 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.679721:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af43050081a8 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.679724:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x52a89496 (ffff880091e4c600) 00010000:00010000:0.0:1715205776.679725:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.679726:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af43050081a8 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.679741:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af43050081a8 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.679765:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af430500819a lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c1b expref: 156 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.679769:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af430500819a lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c1b expref: 156 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.679773:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83d440, rc 0) 00010000:00000080:0.0:1715205776.679776:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009274b900 x1798520455797120/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.679817:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009274b900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+155:11754:x1798520455797120:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 323us (429us total) trans 0 rc 301/301 00000100:00100000:0.0:1715205776.679821:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2040 00000100:00100000:3.0:1715205776.680851:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.680903:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455797248 00000100:00100000:2.0:1715205776.680934:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 569 00000100:00100000:2.0:1715205776.680938:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009274f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+155:11754:x1798520455797248:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.681149:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009274f6c0 x1798520455797248/t330712482746(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.681230:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009274f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455797248:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 291us (380us total) trans 330712482746 rc 0/0 00000100:00100000:2.0:1715205776.681237:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 569 00000100:00100000:3.0:1715205776.682252:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.682760:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455797376 00000100:00100000:1.0:1715205776.682790:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2041 00000100:00100000:1.0:1715205776.682794:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092748e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+156:11754:x1798520455797376:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.682807:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.682820:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050081af lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23c22 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.682877:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050081b6 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.682888:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008193 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c14 expref: 157 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.682897:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050081b6 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.682918:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008193 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c14 expref: 157 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.682926:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008193 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c14 expref: 157 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.682934:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1163c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039168:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.682970:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a641a240 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.683891:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f1163c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039168:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.683909:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050081b6 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.684665:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.684701:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455797440 00010000:00010000:3.0:1715205776.684722:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008193 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c14 expref: 158 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.684762:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4826 00000100:00100000:3.0:1715205776.684766:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+158:1830:x1798520455797440:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1715205776.684774:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.684778:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008193 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c14 expref: 158 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.684784:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008193 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c14 expref: 158 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.684796:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008193 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c14 expref: 158 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.684804:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee0:0x0].0x0 (ffff88012d4a6d00) 00010000:00010000:3.0:1715205776.684806:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050081b6 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.684810:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050081b6 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.684813:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050081b6 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.684823:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205776.684829:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050081b6 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.684836:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050081b6 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205776.684847:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee0:0x0]: returning size 260096 00000100:00100000:3.0:1715205776.684854:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+157:1830:x1798520455797440:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 87us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.684859:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4826 00010000:00010000:1.0:1715205776.684929:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af43050081af lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c22 expref: 158 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.684938:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050081b6 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c22 expref: 157 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.684947:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee0:0x0].0x0 (ffff88012d4a6d00) 00010000:00010000:1.0:1715205776.684949:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205776.684950:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9b840, rc 0) 00010000:00000080:1.0:1715205776.684953:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880092748e40 x1798520455797376/t330712482747(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.684974:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092748e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+157:11754:x1798520455797376:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2179us (2724us total) trans 330712482747 rc 0/0 00000100:00100000:1.0:1715205776.684979:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2041 00000100:00100000:2.0:1715205776.685970:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.686002:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455797504 00000100:00100000:1.0:1715205776.686026:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2042 00000100:00100000:1.0:1715205776.686030:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+157:11754:x1798520455797504:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.686042:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.686050:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050081c4 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23c29 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.686075:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af43050081cb lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.686082:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050081b6 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c22 expref: 158 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.686087:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af43050081cb lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.686103:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050081b6 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c22 expref: 158 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.686112:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050081b6 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c22 expref: 158 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.686118:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1163c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039232:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.686148:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a641a240 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.686872:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f1163c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039232:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.686886:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af43050081cb lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.687064:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.687107:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455797568 00010000:00010000:3.0:1715205776.687122:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050081b6 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c22 expref: 159 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.687145:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4827 00000100:00100000:3.0:1715205776.687297:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+159:1831:x1798520455797568:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1715205776.687306:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.687310:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050081b6 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c22 expref: 159 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.687317:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050081b6 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c22 expref: 159 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.687327:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af43050081b6 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c22 expref: 159 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.687336:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee0:0x0].0x0 (ffff88012d4a6d00) 00010000:00010000:3.0:1715205776.687338:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af43050081cb lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.687344:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af43050081cb lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.687349:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af43050081cb lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.687371:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205776.687392:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+158:1831:x1798520455797568:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 243us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.687398:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4827 00010000:00010000:0.0:1715205776.687440:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af43050081cb lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.687447:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af43050081cb lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.687470:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee0:0x0]: returning size 260096 00000004:00200000:0.0:1715205776.687474:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205776.687483:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af43050081cb lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.687490:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af43050081cb lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.687502:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af43050081c4 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c29 expref: 158 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.687510:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af43050081cb lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c29 expref: 157 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.687515:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee0:0x0].0x0 (ffff88012d4a6d00) 00010000:00010000:0.0:1715205776.687516:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205776.687518:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9a1c0, rc 0) 00010000:00000080:0.0:1715205776.687520:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c4280 x1798520455797504/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.687538:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+157:11754:x1798520455797504:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1508us (1569us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.687546:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2042 00000100:00100000:0.0:1715205776.688860:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.688915:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455797696 00000100:00100000:1.0:1715205776.688935:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2043 00000100:00100000:1.0:1715205776.688937:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+157:11754:x1798520455797696:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.688945:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.688952:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af43050081d2 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23c30 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.688987:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050081d9 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.688994:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007d3a lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a7e expref: 158 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.688997:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050081d9 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.689015:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007d3a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a7e expref: 158 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.689021:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007d3a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a7e expref: 158 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.689030:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f110980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039296:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.689049:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a641a780 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.689836:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f110980 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039296:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.689837:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:1.0:1715205776.689861:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050081d9 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.689912:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455797760 00010000:00010000:2.0:1715205776.689935:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007d3a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a7e expref: 159 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.689962:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4828 00000100:00100000:2.0:1715205776.689967:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+159:1830:x1798520455797760:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1715205776.689978:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.689982:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007d3a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a7e expref: 159 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.689988:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007d3a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a7e expref: 159 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.690001:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305007d3a lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a7e expref: 159 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.690013:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee1:0x0].0x0 (ffff880099676100) 00010000:00010000:2.0:1715205776.690016:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050081d9 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.690024:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050081d9 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.690030:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050081d9 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.690055:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205776.690087:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+158:1830:x1798520455797760:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 119us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.690093:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4828 00010000:00010000:1.0:1715205776.690120:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050081d9 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.690127:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050081d9 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205776.690143:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee1:0x0]: returning size 260096 00010000:00010000:1.0:1715205776.690270:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af43050081d2 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c30 expref: 159 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.690282:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050081d9 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c30 expref: 158 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.690287:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee1:0x0].0x0 (ffff880099676100) 00010000:00010000:1.0:1715205776.690289:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205776.690290:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd99f80, rc 0) 00010000:00000080:1.0:1715205776.690293:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880134ad2f80 x1798520455797696/t330712482748(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.690324:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+158:11754:x1798520455797696:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1386us (1465us total) trans 330712482748 rc 0/0 00000100:00100000:1.0:1715205776.690331:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2043 00000100:00100000:1.0:1715205776.691917:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.691952:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455797824 00000100:00100000:0.0:1715205776.691992:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2044 00000100:00100000:0.0:1715205776.691997:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f110980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+158:11754:x1798520455797824:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.692012:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.692025:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af43050081e7 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23c37 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.692066:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af43050081ee lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.692077:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050081d9 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c30 expref: 159 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.692083:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af43050081ee lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.692105:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050081d9 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c30 expref: 159 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.692114:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050081d9 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c30 expref: 159 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.692123:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880134ad5580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039360:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.692174:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880129e0e540 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.693406:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.693431:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880134ad5580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039360:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.693432:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455797888 00010000:00010000:1.0:1715205776.693449:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af43050081ee lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.693449:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050081d9 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c30 expref: 160 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.693476:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4829 00000100:00100000:3.0:1715205776.693479:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad04c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+160:1830:x1798520455797888:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1715205776.693487:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.693490:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050081d9 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c30 expref: 160 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.693498:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050081d9 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c30 expref: 160 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.693511:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af43050081d9 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c30 expref: 160 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.693519:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee1:0x0].0x0 (ffff880099676100) 00010000:00010000:3.0:1715205776.693522:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af43050081ee lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.693528:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af43050081ee lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.693533:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af43050081ee lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.693554:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205776.693579:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af43050081ee lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.693580:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad04c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+159:1830:x1798520455797888:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 100us (177us total) trans 0 rc 0/0 00010000:00010000:1.0:1715205776.693587:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af43050081ee lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.693589:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4829 00000004:00200000:1.0:1715205776.693615:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee1:0x0]: returning size 260096 00000004:00200000:1.0:1715205776.693639:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205776.693652:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af43050081ee lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.693660:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af43050081ee lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.693675:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af43050081e7 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c37 expref: 159 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.693686:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af43050081ee lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c37 expref: 158 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.693691:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee1:0x0].0x0 (ffff880099676100) 00010000:00010000:1.0:1715205776.693693:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205776.693695:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83e880, rc 0) 00010000:00000080:1.0:1715205776.693698:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f110980 x1798520455797824/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.693723:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f110980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+158:11754:x1798520455797824:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1726us (1809us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.693741:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2044 00000100:00100000:1.0:1715205776.694994:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.695075:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455798016 00000100:00100000:0.0:1715205776.695105:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2045 00000100:00100000:0.0:1715205776.695109:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f113dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+158:11754:x1798520455798016:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.695120:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.695129:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af43050081f5 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23c3e expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.695177:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af43050081fc lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.695187:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007d5d lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a8c expref: 159 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.695192:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af43050081fc lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.695209:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007d5d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a8c expref: 159 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.695217:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007d5d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a8c expref: 159 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.695225:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880134ad50c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039424:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.695262:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880129e0ed80 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.696679:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.696745:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455798080 00000100:00100000:1.0:1715205776.696760:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880134ad50c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039424:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.696761:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007d5d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a8c expref: 160 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.696774:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af43050081fc lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.696783:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4830 00000100:00100000:3.0:1715205776.696786:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c0e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+160:1830:x1798520455798080:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1715205776.696793:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.696797:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007d5d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a8c expref: 160 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.696804:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007d5d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a8c expref: 160 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.696816:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305007d5d lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a8c expref: 160 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.696825:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee2:0x0].0x0 (ffff88012d4a6400) 00010000:00010000:3.0:1715205776.696828:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af43050081fc lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.696833:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af43050081fc lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.696838:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af43050081fc lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.696849:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205776.696875:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c0e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+159:1830:x1798520455798080:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 88us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.696880:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4830 00010000:00010000:1.0:1715205776.696965:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af43050081fc lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.696972:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af43050081fc lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205776.696984:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee2:0x0]: returning size 260096 00010000:00010000:1.0:1715205776.697078:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af43050081f5 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c3e expref: 160 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.697087:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af43050081fc lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c3e expref: 159 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.697092:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee2:0x0].0x0 (ffff88012d4a6400) 00010000:00010000:1.0:1715205776.697094:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205776.697096:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83d200, rc 0) 00010000:00000080:1.0:1715205776.697099:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f113dc0 x1798520455798016/t330712482749(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.697133:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f113dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+159:11754:x1798520455798016:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2023us (2141us total) trans 330712482749 rc 0/0 00000100:00100000:1.0:1715205776.697143:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2045 00000100:00100000:2.0:1715205776.698204:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.698324:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455798144 00000100:00100000:1.0:1715205776.698367:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2046 00000100:00100000:1.0:1715205776.698372:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c50c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+159:11754:x1798520455798144:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.698390:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.698403:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af430500820a lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23c45 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.698451:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305008211 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.698461:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af43050081fc lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c3e expref: 160 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.698467:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305008211 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.698491:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af43050081fc lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c3e expref: 160 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.698499:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af43050081fc lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c3e expref: 160 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.698509:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1176c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039488:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.698561:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a641a780 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.699942:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f1176c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039488:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.699952:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:1.0:1715205776.699962:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305008211 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.700021:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455798208 00010000:00010000:3.0:1715205776.700041:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af43050081fc lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c3e expref: 161 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.700388:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4831 00000100:00100000:3.0:1715205776.700392:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c3900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+161:1831:x1798520455798208:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1715205776.700402:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.700407:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af43050081fc lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c3e expref: 161 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.700415:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af43050081fc lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c3e expref: 161 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.700429:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af43050081fc lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c3e expref: 161 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.700439:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee2:0x0].0x0 (ffff88012d4a6400) 00010000:00010000:3.0:1715205776.700442:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305008211 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.700448:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305008211 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.700453:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305008211 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.700487:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205776.700505:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305008211 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.700513:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305008211 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.700525:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c3900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+160:1831:x1798520455798208:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 133us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.700531:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4831 00000004:00200000:1.0:1715205776.700546:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee2:0x0]: returning size 260096 00000004:00200000:1.0:1715205776.700550:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205776.700563:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305008211 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.700572:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305008211 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.700590:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98240/0xb608af430500820a lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c45 expref: 160 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.700601:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305008211 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c45 expref: 159 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.700607:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee2:0x0].0x0 (ffff88012d4a6400) 00010000:00010000:1.0:1715205776.700609:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205776.700611:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd998c0, rc 0) 00010000:00000080:1.0:1715205776.700616:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c50c0 x1798520455798144/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.700661:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c50c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+159:11754:x1798520455798144:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2289us (2462us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.700668:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2046 00000100:00100000:2.0:1715205776.701955:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.701997:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455798336 00000100:00100000:1.0:1715205776.702027:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2047 00000100:00100000:1.0:1715205776.702031:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c0980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+159:11754:x1798520455798336:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.702042:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.702051:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305008218 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23c4c expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.702110:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500821f lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.702120:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af4305007d80 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a9a expref: 160 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.702125:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500821f lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.702143:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af4305007d80 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a9a expref: 160 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.702151:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af4305007d80 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a9a expref: 160 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.702159:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1176c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039552:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.702196:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a641a780 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.702931:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f1176c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039552:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.702947:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500821f lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.702995:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.703047:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455798400 00010000:00010000:3.0:1715205776.703064:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af4305007d80 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a9a expref: 161 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.703094:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4832 00000100:00100000:3.0:1715205776.703098:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+161:1830:x1798520455798400:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205776.703105:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.703108:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af4305007d80 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a9a expref: 161 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.703115:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af4305007d80 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a9a expref: 161 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.703126:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af4305007d80 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a9a expref: 161 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.703135:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee3:0x0].0x0 (ffff88009399ee00) 00010000:00010000:3.0:1715205776.703138:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500821f lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.703144:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500821f lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.703152:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500821f lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.703163:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205776.703168:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500821f lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.703182:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500821f lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.703192:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+160:1830:x1798520455798400:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 93us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.703198:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4832 00000004:00200000:1.0:1715205776.703199:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee3:0x0]: returning size 260096 00010000:00010000:1.0:1715205776.703339:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a880/0xb608af4305008218 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c4c expref: 161 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.703358:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500821f lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c4c expref: 160 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.703363:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee3:0x0].0x0 (ffff88009399ee00) 00010000:00010000:1.0:1715205776.703365:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205776.703367:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd99200, rc 0) 00010000:00000080:1.0:1715205776.703378:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c0980 x1798520455798336/t330712482750(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.703415:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c0980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+160:11754:x1798520455798336:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1383us (1461us total) trans 330712482750 rc 0/0 00000100:00100000:1.0:1715205776.703421:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2047 00000100:00100000:2.0:1715205776.704343:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.704390:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455798464 00000100:00100000:1.0:1715205776.704408:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2048 00000100:00100000:1.0:1715205776.704412:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+160:11754:x1798520455798464:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.704425:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.704435:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af430500822d lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23c53 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.704468:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af4305008234 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.704483:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500821f lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c4c expref: 161 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.704489:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af4305008234 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.704509:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500821f lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c4c expref: 161 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.704517:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500821f lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c4c expref: 161 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.704527:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1176c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039616:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.704566:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a641a780 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.705284:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f1176c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039616:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.705299:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af4305008234 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.705404:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.705458:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455798528 00010000:00010000:3.0:1715205776.705470:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500821f lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c4c expref: 162 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.705490:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4833 00000100:00100000:3.0:1715205776.705494:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:1830:x1798520455798528:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1715205776.705499:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.705502:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500821f lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c4c expref: 162 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.705508:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500821f lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c4c expref: 162 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.705516:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99200/0xb608af430500821f lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c4c expref: 162 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.705523:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee3:0x0].0x0 (ffff88009399ee00) 00010000:00010000:3.0:1715205776.705525:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af4305008234 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.705534:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af4305008234 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.705538:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af4305008234 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.705547:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.705553:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af4305008234 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.705559:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af4305008234 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.705567:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+161:1830:x1798520455798528:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 73us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.705572:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4833 00000004:00200000:0.0:1715205776.705577:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee3:0x0]: returning size 260096 00000004:00200000:0.0:1715205776.705580:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205776.705596:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af4305008234 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.705603:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af4305008234 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.705635:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9bcc0/0xb608af430500822d lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c53 expref: 161 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.705643:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af4305008234 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c53 expref: 160 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.705647:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee3:0x0].0x0 (ffff88009399ee00) 00010000:00010000:0.0:1715205776.705649:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205776.705650:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9b3c0, rc 0) 00010000:00000080:0.0:1715205776.705654:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c1c80 x1798520455798464/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.705676:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+160:11754:x1798520455798464:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1264us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.705681:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2048 00000100:00100000:2.0:1715205776.706725:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.706756:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455798656 00000100:00100000:0.0:1715205776.706777:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2049 00000100:00100000:0.0:1715205776.706780:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+160:11754:x1798520455798656:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.706787:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.706795:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af430500823b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23c5a expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.706835:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008242 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.706844:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007da3 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aa8 expref: 161 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.706849:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008242 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.706865:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007da3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aa8 expref: 161 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.706872:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007da3 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aa8 expref: 161 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.706879:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880134ad63c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039680:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.706903:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880129e0ed80 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.707610:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880134ad63c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039680:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.707636:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008242 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.707893:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.707947:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455798720 00010000:00010000:3.0:1715205776.707960:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007da3 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aa8 expref: 162 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.707985:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4834 00000100:00100000:3.0:1715205776.707992:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129eb9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:1831:x1798520455798720:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1715205776.707999:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.708002:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007da3 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aa8 expref: 162 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.708009:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007da3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aa8 expref: 162 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.708019:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af4305007da3 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23aa8 expref: 162 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.708027:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100c:0x0].0x0 (ffff88012d4a6900) 00010000:00010000:3.0:1715205776.708030:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008242 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.708035:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008242 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.708039:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008242 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.708049:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205776.708056:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008242 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.708062:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008242 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.708065:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129eb9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+161:1831:x1798520455798720:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 72us (173us total) trans 0 rc 0/0 00000004:00200000:1.0:1715205776.708069:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x100c:0x0]: returning size 543 00000100:00100000:3.0:1715205776.708070:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4834 00010000:00010000:1.0:1715205776.708143:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af430500823b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c5a expref: 162 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.708153:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008242 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c5a expref: 161 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.708159:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100c:0x0].0x0 (ffff88012d4a6900) 00010000:00010000:1.0:1715205776.708161:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205776.708163:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83dd40, rc 0) 00010000:00000080:1.0:1715205776.708166:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c76c0 x1798520455798656/t330712482751(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.708190:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+161:11754:x1798520455798656:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1409us (1465us total) trans 330712482751 rc 0/0 00000100:00100000:1.0:1715205776.708195:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2049 00000100:00100000:2.0:1715205776.709036:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.709084:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455798784 00000100:00100000:1.0:1715205776.709102:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2050 00000100:00100000:1.0:1715205776.709105:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+161:11754:x1798520455798784:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.709115:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.709122:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af4305008250 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23c61 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.709145:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305008257 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.709152:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008242 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c5a expref: 162 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.709157:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305008257 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.709176:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008242 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c5a expref: 162 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.709186:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008242 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c5a expref: 162 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.709193:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f115a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039744:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.709220:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a641a180 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.709926:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f115a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039744:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.709939:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305008257 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.710084:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.710123:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455798848 00010000:00010000:3.0:1715205776.710136:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008242 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c5a expref: 163 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.710160:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4835 00000100:00100000:3.0:1715205776.710168:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c0e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+163:1831:x1798520455798848:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1715205776.710174:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.710178:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008242 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c5a expref: 163 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.710184:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008242 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c5a expref: 163 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.710194:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008242 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c5a expref: 163 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.710206:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100c:0x0].0x0 (ffff88012d4a6900) 00010000:00010000:3.0:1715205776.710208:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305008257 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.710214:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305008257 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.710218:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305008257 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.710236:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205776.710246:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305008257 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.710251:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305008257 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.710260:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c0e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:1831:x1798520455798848:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 94us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.710265:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4835 00000004:00200000:1.0:1715205776.710268:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x100c:0x0]: returning size 543 00000004:00200000:1.0:1715205776.710269:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205776.710276:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305008257 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.710281:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305008257 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.710290:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd986c0/0xb608af4305008250 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c61 expref: 162 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.710298:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305008257 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c61 expref: 161 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.710303:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x100c:0x0].0x0 (ffff88012d4a6900) 00010000:00010000:1.0:1715205776.710305:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205776.710307:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd98d80, rc 0) 00010000:00000080:1.0:1715205776.710310:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c1300 x1798520455798784/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.710333:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+161:11754:x1798520455798784:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1227us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.710339:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2050 00000100:00100000:2.0:1715205776.711210:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.711262:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455798912 00000100:00100000:1.0:1715205776.711280:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2051 00000100:00100000:1.0:1715205776.711284:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+161:11754:x1798520455798912:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.711292:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.711299:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af430500825e lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23c68 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.711321:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305008265 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.711328:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305008265 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.711334:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305008265 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.711343:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af430500826c lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x85ed8f9c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.711347:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af430500826c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.711352:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af430500826c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.711400:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305008265 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.711404:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305008265 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.711409:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305008265 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.711413:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd9b840 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.711415:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305008265 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.711420:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305008265 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.711426:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205776.711428:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.711430:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305008265 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.711434:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b840/0xb608af4305008265 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.711439:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af430500826c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.711443:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af430500826c lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.711450:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af430500826c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.711454:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012bd9ad00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.711455:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af430500826c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.711458:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af430500826c lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.711462:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x85ed8f9c (ffff880129cf6500) 00010000:00010000:1.0:1715205776.711463:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.711464:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af430500826c lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.711467:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ad00/0xb608af430500826c lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.711490:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af430500825e lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c68 expref: 162 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.711496:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99f80/0xb608af430500825e lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c68 expref: 162 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.711501:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd99f80, rc 0) 00010000:00000080:1.0:1715205776.711504:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c3900 x1798520455798912/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.711537:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+161:11754:x1798520455798912:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 252us (327us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205776.711543:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2051 00000100:00100000:2.0:1715205776.712372:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.712411:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455798976 00000100:00100000:1.0:1715205776.712433:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2052 00000100:00100000:1.0:1715205776.712437:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+161:11754:x1798520455798976:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.712443:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.712450:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305008273 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23c6f expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.712471:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500827a lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.712477:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500827a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.712483:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500827a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.712490:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305008281 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.712495:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305008281 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.712499:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305008281 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.712523:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500827a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.712532:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500827a lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.712537:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500827a lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.712541:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59eac0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.712543:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500827a lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.712547:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500827a lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.712553:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205776.712554:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.712556:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500827a lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.712560:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500827a lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.712566:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305008281 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.712571:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305008281 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.712575:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305008281 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.712582:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59dd40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.712583:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305008281 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.712588:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305008281 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.712592:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0xec6f74b7 (ffff880129cf6900) 00010000:00010000:1.0:1715205776.712594:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.712594:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305008281 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.712598:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305008281 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.712641:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305008273 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c6f expref: 162 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.712647:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b600/0xb608af4305008273 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c6f expref: 162 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.712653:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012bd9b600, rc 0) 00010000:00000080:1.0:1715205776.712656:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c2ac0 x1798520455798976/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.712685:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+161:11754:x1798520455798976:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 248us (314us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205776.712690:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2052 00000100:00100000:2.0:1715205776.714466:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.714499:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455799040 00000100:00100000:1.0:1715205776.714517:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2053 00000100:00100000:1.0:1715205776.714520:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+161:11754:x1798520455799040:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.714527:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.714533:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305008288 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23c76 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.714547:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59cb40/0xb608af430500828f lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.714552:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59cb40/0xb608af430500828f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.714557:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59cb40/0xb608af430500828f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.714597:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af4305008288 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c76 expref: 163 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.714603:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59cb40/0xb608af430500828f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c76 expref: 162 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.714606:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee3:0x0].0x0 (ffff88009399ee00) 00010000:00010000:1.0:1715205776.714607:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1715205776.714609:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59cb40, rc 0) 00010000:00000080:1.0:1715205776.714611:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c2f80 x1798520455799040/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 568/1160 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.714669:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:11754:x1798520455799040:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 144us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.714677:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2053 00000100:00100000:2.0:1715205776.715742:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.715785:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455799104 00000100:00100000:1.0:1715205776.715801:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2054 00000100:00100000:1.0:1715205776.715805:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:11754:x1798520455799104:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.715812:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.715819:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305008296 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23c7d expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.715842:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af430500829d lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.715849:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af430500829d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.715856:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af430500829d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.715865:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af43050082a4 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.715870:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af43050082a4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.715874:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af43050082a4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.715918:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af430500829d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.715926:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af430500829d lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.715930:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af430500829d lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.715933:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59ed00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.715935:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af430500829d lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.715939:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af430500829d lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.715945:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205776.715946:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.715948:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af430500829d lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.715951:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af430500829d lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.715956:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af43050082a4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.715960:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af43050082a4 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.715963:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af43050082a4 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.715971:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59f3c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.715973:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af43050082a4 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.715977:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af43050082a4 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.715982:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x54f6b75a (ffff8800b7b20a00) 00010000:00010000:1.0:1715205776.715984:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.715985:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af43050082a4 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.715989:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af43050082a4 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.716009:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305008296 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c7d expref: 163 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.716013:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305008296 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c7d expref: 163 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.716016:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59db00, rc 0) 00010000:00000080:1.0:1715205776.716018:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c5a40 x1798520455799104/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.716042:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:11754:x1798520455799104:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 237us (302us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205776.716045:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2054 00000100:00100000:2.0:1715205776.717313:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.717362:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455799232 00000100:00100000:1.0:1715205776.717383:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2055 00000100:00100000:1.0:1715205776.717387:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+162:11754:x1798520455799232:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.717394:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.717401:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af43050082ab lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23c84 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.717454:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af43050082b2 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.717464:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af4305007f55 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b50 expref: 163 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.717469:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af43050082b2 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.717492:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af4305007f55 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b50 expref: 163 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.717501:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af4305007f55 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b50 expref: 163 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.717510:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f112ac0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039808:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.717554:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a641a600 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.718977:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.718998:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455799296 00010000:00010000:3.0:1715205776.719012:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af4305007f55 lrc: 5/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b50 expref: 164 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.719030:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4836 00000100:00100000:3.0:1715205776.719034:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad63c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+164:1830:x1798520455799296:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205776.719040:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.719043:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af4305007f55 lrc: 5/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b50 expref: 164 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.719051:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af4305007f55 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b50 expref: 164 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.719058:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f112ac0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039808:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.719066:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af4305007f55 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b50 expref: 164 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.719074:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:3.0:1715205776.719077:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af43050082b2 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.719082:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af43050082b2 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.719087:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af43050082b2 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.719095:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af43050082b2 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.719097:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205776.719106:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af43050082b2 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.719111:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af43050082b2 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.719117:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad63c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+163:1830:x1798520455799296:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 82us (141us total) trans 0 rc 0/0 00000004:00200000:1.0:1715205776.719122:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee4:0x0]: returning size 260096 00000100:00100000:3.0:1715205776.719122:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4836 00010000:00010000:1.0:1715205776.719221:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af43050082ab lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c84 expref: 164 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.719234:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af43050082b2 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c84 expref: 163 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.719242:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:1.0:1715205776.719244:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205776.719245:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59c240, rc 0) 00010000:00000080:1.0:1715205776.719248:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c2140 x1798520455799232/t330712482752(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.719277:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+163:11754:x1798520455799232:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1889us (1967us total) trans 330712482752 rc 0/0 00000100:00100000:1.0:1715205776.719282:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2055 00000100:00100000:0.0:1715205776.720172:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.720236:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455799360 00000100:00100000:2.0:1715205776.720269:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2056 00000100:00100000:2.0:1715205776.720277:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+163:11754:x1798520455799360:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.720287:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.720293:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af43050082c0 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23c8b expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.720320:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050082c7 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.720329:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af43050082b2 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c84 expref: 164 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.720334:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050082c7 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.720351:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af43050082b2 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c84 expref: 164 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.720358:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af43050082b2 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c84 expref: 164 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.720366:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d4c17c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039872:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.720397:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a9158780 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.721277:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d4c17c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039872:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.721288:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050082c7 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.721817:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.721855:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455799424 00010000:00010000:3.0:1715205776.721868:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af43050082b2 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c84 expref: 165 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.721886:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4837 00000100:00100000:3.0:1715205776.721889:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c6880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+165:1831:x1798520455799424:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1715205776.721895:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.721898:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af43050082b2 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c84 expref: 165 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.721909:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af43050082b2 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c84 expref: 165 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.721919:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c240/0xb608af43050082b2 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c84 expref: 165 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.721927:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:3.0:1715205776.721929:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050082c7 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.721935:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050082c7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.721939:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050082c7 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.721952:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205776.721970:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c6880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+164:1831:x1798520455799424:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 80us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.721975:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4837 00010000:00010000:3.0:1715205776.722024:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050082c7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.722030:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050082c7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205776.722050:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee4:0x0]: returning size 260096 00000004:00200000:3.0:1715205776.722053:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205776.722062:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050082c7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.722069:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050082c7 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.722082:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af43050082c0 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c8b expref: 164 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.722092:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050082c7 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c8b expref: 163 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.722096:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:3.0:1715205776.722098:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205776.722099:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fadb600, rc 0) 00010000:00000080:3.0:1715205776.722102:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880134ad76c0 x1798520455799360/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.722122:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+163:11754:x1798520455799360:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1845us (1951us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.722127:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2056 00000100:00100000:2.0:1715205776.723762:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.723835:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455799488 00000100:00100000:3.0:1715205776.723879:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2057 00000100:00100000:3.0:1715205776.723884:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c4740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+163:11754:x1798520455799488:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.723899:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.723916:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af43050082ce lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23c92 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.723957:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050082d5 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.723968:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050082d5 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.723977:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050082d5 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.723998:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af43050082dc lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.724003:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af43050082dc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.724009:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af43050082dc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.724077:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050082d5 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.724083:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050082d5 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.724088:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050082d5 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.724093:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73acfc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205776.724096:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050082d5 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.724102:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050082d5 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.724111:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205776.724113:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205776.724116:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050082d5 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.724121:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050082d5 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.724135:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af43050082dc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.724140:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af43050082dc lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.724144:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af43050082dc lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.724148:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ad440 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205776.724149:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af43050082dc lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.724154:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af43050082dc lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.724159:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x54f6b75a (ffff88012cbdcf00) 00010000:00010000:3.0:1715205776.724161:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205776.724162:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af43050082dc lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.724171:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af43050082dc lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.724203:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af43050082ce lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c92 expref: 164 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.724208:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af43050082ce lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c92 expref: 164 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.724216:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73aed00, rc 0) 00010000:00000080:3.0:1715205776.724220:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c4740 x1798520455799488/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.724258:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c4740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+163:11754:x1798520455799488:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 374us (501us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205776.724265:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2057 00000100:00100000:2.0:1715205776.725298:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.725318:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455799616 00000100:00100000:2.0:1715205776.725344:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 570 00000100:00100000:2.0:1715205776.725348:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+163:11754:x1798520455799616:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.725461:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c6d40 x1798520455799616/t330712482753(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.725491:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+164:11754:x1798520455799616:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 143us (195us total) trans 330712482753 rc 0/0 00000100:00100000:2.0:1715205776.725497:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 570 00000100:00100000:3.0:1715205776.726501:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.726518:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455799744 00000100:00100000:3.0:1715205776.726537:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2058 00000100:00100000:3.0:1715205776.726541:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092749c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+164:11754:x1798520455799744:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.726549:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.726560:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af43050082e3 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23c99 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.726611:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050082ea lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.726640:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050082c7 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c8b expref: 165 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.726646:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050082ea lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.726668:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050082c7 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c8b expref: 165 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.726676:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050082c7 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c8b expref: 165 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.726685:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009274cc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039936:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.726715:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099b38600 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.727652:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009274cc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456039936:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.727664:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050082ea lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.728288:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.728326:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455799808 00010000:00010000:2.0:1715205776.728341:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050082c7 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c8b expref: 166 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.728368:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4838 00000100:00100000:2.0:1715205776.728372:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009274d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+166:1831:x1798520455799808:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1715205776.728379:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.728382:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050082c7 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c8b expref: 166 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.728390:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050082c7 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c8b expref: 166 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.728401:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050082c7 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c8b expref: 166 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.728411:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:2.0:1715205776.728413:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050082ea lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.728419:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050082ea lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.728424:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050082ea lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.728435:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205776.728451:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009274d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+165:1831:x1798520455799808:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 80us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.728456:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4838 00010000:00010000:2.0:1715205776.728468:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050082ea lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.728473:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050082ea lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.728483:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee4:0x0]: returning size 260096 00010000:00010000:2.0:1715205776.728552:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af43050082e3 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c99 expref: 166 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.728563:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050082ea lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c99 expref: 165 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.728568:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:2.0:1715205776.728570:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.728571:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73acd80, rc 0) 00010000:00000080:2.0:1715205776.728575:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880092749c80 x1798520455799744/t330712482754(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.728593:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092749c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+165:11754:x1798520455799744:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2052us (2094us total) trans 330712482754 rc 0/0 00000100:00100000:2.0:1715205776.728597:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2058 00000100:00100000:0.0:1715205776.729423:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.729490:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455799872 00000100:00100000:2.0:1715205776.729530:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2059 00000100:00100000:2.0:1715205776.729535:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+165:11754:x1798520455799872:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.729552:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.729564:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af43050082f8 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23ca0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.729602:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af43050082ff lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.729612:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050082ea lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c99 expref: 166 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.729638:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af43050082ff lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.729665:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050082ea lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c99 expref: 166 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.729674:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050082ea lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c99 expref: 166 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.729686:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d4c5f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040000:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.729741:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a9158180 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.730367:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d4c5f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040000:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.730381:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af43050082ff lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.730442:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.730511:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455799936 00010000:00010000:2.0:1715205776.730527:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050082ea lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c99 expref: 167 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.730545:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4839 00000100:00100000:2.0:1715205776.730549:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad17c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:1831:x1798520455799936:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1715205776.730555:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.730558:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050082ea lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c99 expref: 167 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.730566:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050082ea lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c99 expref: 167 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.730576:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050082ea lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c99 expref: 167 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.730586:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:2.0:1715205776.730589:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af43050082ff lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.730599:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af43050082ff lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.730604:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af43050082ff lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.730637:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205776.730648:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af43050082ff lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.730655:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af43050082ff lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.730659:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad17c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+166:1831:x1798520455799936:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 109us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.730664:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4839 00000004:00200000:3.0:1715205776.730675:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee4:0x0]: returning size 260096 00000004:00200000:3.0:1715205776.730678:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205776.730687:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af43050082ff lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.730693:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af43050082ff lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.730711:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af43050082f8 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ca0 expref: 166 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.730720:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af43050082ff lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ca0 expref: 165 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.730725:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:3.0:1715205776.730741:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205776.730743:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fadaac0, rc 0) 00010000:00000080:3.0:1715205776.730746:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880134ad2140 x1798520455799872/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.730771:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+165:11754:x1798520455799872:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1236us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.730777:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2059 00000100:00100000:0.0:1715205776.731833:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.731873:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455800064 00000100:00100000:3.0:1715205776.731892:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2060 00000100:00100000:3.0:1715205776.731894:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+165:11754:x1798520455800064:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.731903:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.731914:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305008306 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23ca7 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.731957:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af430500830d lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.731966:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af4305007aa1 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2397b expref: 166 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.731975:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af430500830d lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.731991:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af4305007aa1 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2397b expref: 166 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.731999:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af4305007aa1 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2397b expref: 166 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.732007:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009274d0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040064:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.732038:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099b38cc0 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.732589:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009274d0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040064:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.732601:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af430500830d lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.733208:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.733251:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455800128 00010000:00010000:3.0:1715205776.733263:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af4305007aa1 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2397b expref: 167 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.733287:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4840 00000100:00100000:3.0:1715205776.733291:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad4c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:1830:x1798520455800128:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205776.733297:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.733300:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af4305007aa1 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2397b expref: 167 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.733306:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af4305007aa1 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2397b expref: 167 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.733317:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a640/0xb608af4305007aa1 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2397b expref: 167 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.733324:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee5:0x0].0x0 (ffff8800a5d65a00) 00010000:00010000:3.0:1715205776.733326:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af430500830d lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.733332:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af430500830d lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.733336:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af430500830d lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.733347:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205776.733375:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad4c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+166:1830:x1798520455800128:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 83us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.733380:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4840 00010000:00010000:0.0:1715205776.733414:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af430500830d lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.733422:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af430500830d lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.733432:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee5:0x0]: returning size 260096 00010000:00010000:0.0:1715205776.733515:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af4305008306 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ca7 expref: 167 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.733526:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af430500830d lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ca7 expref: 166 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.733536:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee5:0x0].0x0 (ffff8800a5d65a00) 00010000:00010000:0.0:1715205776.733537:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205776.733539:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ae400, rc 0) 00010000:00000080:0.0:1715205776.733543:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880134ad5f00 x1798520455800064/t330712482755(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.733574:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+166:11754:x1798520455800064:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1678us (1742us total) trans 330712482755 rc 0/0 00000100:00100000:0.0:1715205776.733579:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2060 00000100:00100000:0.0:1715205776.734993:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.735043:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455800192 00000100:00100000:1.0:1715205776.735072:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2061 00000100:00100000:1.0:1715205776.735076:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+166:11754:x1798520455800192:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.735089:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.735097:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af430500831b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23cae expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.735126:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305008322 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.735135:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af430500830d lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ca7 expref: 167 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.735140:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305008322 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.735158:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af430500830d lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ca7 expref: 167 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.735167:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af430500830d lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ca7 expref: 167 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.735175:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f112ac0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040128:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.735216:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a641a600 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.736802:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f112ac0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040128:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.736820:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305008322 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.736824:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.736869:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455800256 00010000:00010000:2.0:1715205776.736884:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af430500830d lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ca7 expref: 168 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.736912:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4841 00000100:00100000:2.0:1715205776.736916:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+168:1830:x1798520455800256:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1715205776.736923:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.736926:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af430500830d lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ca7 expref: 168 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.736932:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af430500830d lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ca7 expref: 168 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.736943:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af430500830d lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ca7 expref: 168 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.736952:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee5:0x0].0x0 (ffff8800a5d65a00) 00010000:00010000:2.0:1715205776.736955:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305008322 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.736961:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305008322 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.736966:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305008322 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.736986:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205776.737005:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:1830:x1798520455800256:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 89us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.737042:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4841 00010000:00010000:1.0:1715205776.737158:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305008322 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.737166:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305008322 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205776.737192:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee5:0x0]: returning size 260096 00000004:00200000:1.0:1715205776.737195:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205776.737205:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305008322 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.737216:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305008322 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.737231:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af430500831b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cae expref: 167 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.737241:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305008322 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cae expref: 166 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.737246:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee5:0x0].0x0 (ffff8800a5d65a00) 00010000:00010000:1.0:1715205776.737248:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205776.737249:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59e640, rc 0) 00010000:00000080:1.0:1715205776.737253:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880134ad0000 x1798520455800192/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.737286:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+166:11754:x1798520455800192:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2209us (2295us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.737292:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2061 00000100:00100000:1.0:1715205776.738814:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.738863:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455800384 00000100:00100000:0.0:1715205776.738892:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2062 00000100:00100000:0.0:1715205776.738896:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1117c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+166:11754:x1798520455800384:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.738906:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.738917:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008329 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23cb5 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.738966:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008330 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.738976:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305007ac4 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23989 expref: 167 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.738984:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008330 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.739004:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305007ac4 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23989 expref: 167 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.739013:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305007ac4 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23989 expref: 167 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.739022:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880134ad04c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040192:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.739058:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880129e0ed80 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.739915:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.739935:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455800448 00010000:00010000:1.0:1715205776.739948:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305007ac4 lrc: 5/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23989 expref: 168 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.739966:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4842 00000100:00100000:1.0:1715205776.739970:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f111300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+168:1831:x1798520455800448:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1715205776.739973:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880134ad04c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040192:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.739982:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.739986:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305007ac4 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23989 expref: 168 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.739987:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008330 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.739993:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305007ac4 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23989 expref: 168 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.740006:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305007ac4 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23989 expref: 168 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.740014:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee6:0x0].0x0 (ffff88008f367800) 00010000:00010000:1.0:1715205776.740017:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008330 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.740023:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008330 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.740027:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008330 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.740044:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.740045:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008330 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.740050:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008330 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.740060:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee6:0x0]: returning size 260096 00000100:00100000:1.0:1715205776.740061:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f111300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:1831:x1798520455800448:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 90us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.740068:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4842 00010000:00010000:0.0:1715205776.740143:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af4305008329 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cb5 expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.740151:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008330 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cb5 expref: 167 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.740160:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee6:0x0].0x0 (ffff88008f367800) 00010000:00010000:0.0:1715205776.740162:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205776.740163:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83d8c0, rc 0) 00010000:00000080:0.0:1715205776.740166:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f1117c0 x1798520455800384/t330712482756(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.740196:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1117c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455800384:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1300us (1385us total) trans 330712482756 rc 0/0 00000100:00100000:0.0:1715205776.740202:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2062 00000100:00100000:1.0:1715205776.741205:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.741223:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455800512 00000100:00100000:0.0:1715205776.741240:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2063 00000100:00100000:0.0:1715205776.741243:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f112ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455800512:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.741253:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.741259:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af430500833e lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23cbc expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.741284:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af4305008345 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.741290:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008330 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cb5 expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.741295:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af4305008345 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.741308:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008330 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cb5 expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.741319:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008330 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cb5 expref: 168 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.741326:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880134ad04c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040256:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.741356:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880129e0ed80 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.742082:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880134ad04c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040256:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.742093:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af4305008345 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.742309:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.742350:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455800576 00010000:00010000:2.0:1715205776.742363:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008330 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cb5 expref: 169 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.742387:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4843 00000100:00100000:2.0:1715205776.742390:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f115a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+169:1831:x1798520455800576:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1715205776.742397:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.742401:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008330 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cb5 expref: 169 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.742408:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008330 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cb5 expref: 169 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.742418:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008330 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cb5 expref: 169 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.742430:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee6:0x0].0x0 (ffff88008f367800) 00010000:00010000:2.0:1715205776.742432:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af4305008345 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.742438:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af4305008345 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.742443:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af4305008345 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.742462:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.742475:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af4305008345 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.742481:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f115a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+168:1831:x1798520455800576:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 90us (173us total) trans 0 rc 0/0 00010000:00010000:0.0:1715205776.742482:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af4305008345 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.742486:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4843 00000004:00200000:0.0:1715205776.742504:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee6:0x0]: returning size 260096 00000004:00200000:0.0:1715205776.742506:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205776.742516:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af4305008345 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.742522:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af4305008345 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.742535:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af430500833e lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cbc expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.742543:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af4305008345 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cbc expref: 167 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.742549:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee6:0x0].0x0 (ffff88008f367800) 00010000:00010000:0.0:1715205776.742551:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205776.742552:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83d200, rc 0) 00010000:00000080:0.0:1715205776.742556:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f112ac0 x1798520455800512/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.742579:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f112ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455800512:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1334us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.742583:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2063 00000100:00100000:1.0:1715205776.743881:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.743948:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455800704 00000100:00100000:0.0:1715205776.743976:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2064 00000100:00100000:0.0:1715205776.743980:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1176c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+167:11754:x1798520455800704:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.743989:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.743997:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af430500834c lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23cc3 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.744077:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305008353 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.744087:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007ae7 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23997 expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.744092:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305008353 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.744109:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007ae7 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23997 expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.744121:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007ae7 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23997 expref: 168 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.744130:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880134ad04c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040320:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.744162:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880129e0ed80 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.745057:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880134ad04c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040320:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.745069:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305008353 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.745157:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.745192:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455800768 00010000:00010000:2.0:1715205776.745205:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007ae7 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23997 expref: 169 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.745224:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4844 00000100:00100000:2.0:1715205776.745228:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1163c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+169:1830:x1798520455800768:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1715205776.745234:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.745236:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007ae7 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23997 expref: 169 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.745243:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007ae7 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23997 expref: 169 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.745256:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9af40/0xb608af4305007ae7 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23997 expref: 169 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.745264:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee7:0x0].0x0 (ffff88008f367600) 00010000:00010000:2.0:1715205776.745266:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305008353 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.745272:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305008353 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.745276:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305008353 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.745296:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205776.745312:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1163c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+168:1830:x1798520455800768:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 83us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.745316:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4844 00010000:00010000:0.0:1715205776.745340:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305008353 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.745346:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305008353 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.745355:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee7:0x0]: returning size 260096 00010000:00010000:0.0:1715205776.745440:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af430500834c lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cc3 expref: 169 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.745450:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305008353 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cc3 expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.745455:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee7:0x0].0x0 (ffff88008f367600) 00010000:00010000:0.0:1715205776.745457:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205776.745458:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83d440, rc 0) 00010000:00000080:0.0:1715205776.745462:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f1176c0 x1798520455800704/t330712482757(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.745500:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1176c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+168:11754:x1798520455800704:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1520us (1620us total) trans 330712482757 rc 0/0 00000100:00100000:0.0:1715205776.745506:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2064 00000100:00100000:2.0:1715205776.746751:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.746811:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455800832 00000100:00100000:0.0:1715205776.746831:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2065 00000100:00100000:0.0:1715205776.746834:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c0e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+168:11754:x1798520455800832:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.746844:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.746851:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af4305008361 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23cca expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.746910:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305008368 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.746919:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305008353 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cc3 expref: 169 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.746924:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305008368 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.746941:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305008353 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cc3 expref: 169 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.746950:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305008353 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cc3 expref: 169 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.746959:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880134ad04c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040384:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.746988:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880129e0ed80 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.747805:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880134ad04c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040384:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.747815:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305008368 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.748210:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.748235:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455800896 00010000:00010000:0.0:1715205776.748261:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305008353 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cc3 expref: 170 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.748293:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4845 00000100:00100000:0.0:1715205776.748298:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c6880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+170:1831:x1798520455800896:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205776.748308:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.748311:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305008353 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cc3 expref: 170 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.748317:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305008353 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cc3 expref: 170 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.748330:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af4305008353 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cc3 expref: 170 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.748339:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee7:0x0].0x0 (ffff88008f367600) 00010000:00010000:0.0:1715205776.748341:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305008368 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.748346:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305008368 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.748350:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305008368 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.748364:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205776.748374:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305008368 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.748387:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305008368 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.748397:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c6880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+169:1831:x1798520455800896:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 99us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.748403:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4845 00000004:00200000:1.0:1715205776.748410:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee7:0x0]: returning size 260096 00000004:00200000:1.0:1715205776.748413:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205776.748424:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305008368 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.748432:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305008368 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.748448:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c900/0xb608af4305008361 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cca expref: 169 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.748459:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305008368 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cca expref: 168 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.748466:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee7:0x0].0x0 (ffff88008f367600) 00010000:00010000:1.0:1715205776.748468:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205776.748469:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83db00, rc 0) 00010000:00000080:1.0:1715205776.748473:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c0e40 x1798520455800832/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.748501:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c0e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+168:11754:x1798520455800832:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1665us (1750us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.748506:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2065 00000100:00100000:2.0:1715205776.749868:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.749885:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455801024 00000100:00100000:2.0:1715205776.749906:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2066 00000100:00100000:2.0:1715205776.749909:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+168:11754:x1798520455801024:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.749918:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.749925:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af430500836f lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23cd1 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.749974:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305008376 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.749982:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007b0a lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239a5 expref: 169 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.749987:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305008376 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.750003:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007b0a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239a5 expref: 169 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.750009:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007b0a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239a5 expref: 169 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.750017:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d4c17c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040448:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.750042:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a91580c0 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.751442:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.751467:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455801088 00010000:00010000:0.0:1715205776.751487:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007b0a lrc: 5/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239a5 expref: 170 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.751513:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d4c17c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040448:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.751515:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4846 00000100:00100000:0.0:1715205776.751519:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad04c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+170:1831:x1798520455801088:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1715205776.751527:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305008376 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.751529:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.751534:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007b0a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239a5 expref: 170 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.751542:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007b0a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239a5 expref: 170 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.751558:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c000/0xb608af4305007b0a lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239a5 expref: 170 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.751567:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee8:0x0].0x0 (ffff88009399e700) 00010000:00010000:0.0:1715205776.751570:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305008376 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.751576:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305008376 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.751585:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305008376 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.751599:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.751607:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305008376 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.751613:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305008376 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.751640:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee8:0x0]: returning size 260096 00000100:00100000:0.0:1715205776.751641:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad04c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+169:1831:x1798520455801088:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 122us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.751646:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4846 00010000:00010000:2.0:1715205776.751754:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af430500836f lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cd1 expref: 170 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.751765:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305008376 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cd1 expref: 169 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.751771:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee8:0x0].0x0 (ffff88009399e700) 00010000:00010000:2.0:1715205776.751773:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.751775:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fada400, rc 0) 00010000:00000080:2.0:1715205776.751779:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c5f00 x1798520455801024/t330712482758(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.751807:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+169:11754:x1798520455801024:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1897us (1940us total) trans 330712482758 rc 0/0 00000100:00100000:2.0:1715205776.751812:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2066 00000100:00100000:2.0:1715205776.753313:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.753332:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455801152 00000100:00100000:2.0:1715205776.753356:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2067 00000100:00100000:2.0:1715205776.753360:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+169:11754:x1798520455801152:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.753373:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.753382:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305008384 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23cd8 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.753416:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500838b lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.753426:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305008376 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cd1 expref: 170 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.753436:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500838b lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.753457:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305008376 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cd1 expref: 170 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.753465:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305008376 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cd1 expref: 170 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.753474:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6dec740 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040512:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.753504:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a91580c0 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.754153:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6dec740 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040512:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.754166:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500838b lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.754339:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.754380:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455801216 00010000:00010000:0.0:1715205776.754400:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305008376 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cd1 expref: 171 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.754426:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4847 00000100:00100000:0.0:1715205776.754430:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009274d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:1830:x1798520455801216:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1715205776.754437:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.754439:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305008376 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cd1 expref: 171 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.754445:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305008376 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cd1 expref: 171 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.754456:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af4305008376 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cd1 expref: 171 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.754466:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee8:0x0].0x0 (ffff88009399e700) 00010000:00010000:0.0:1715205776.754469:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500838b lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.754479:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500838b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.754484:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500838b lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.754505:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.754523:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500838b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.754528:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009274d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+170:1830:x1798520455801216:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 98us (191us total) trans 0 rc 0/0 00010000:00010000:2.0:1715205776.754529:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500838b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.754533:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4847 00000004:00200000:2.0:1715205776.754549:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee8:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.754551:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.754560:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500838b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.754565:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500838b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.754578:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af4305008384 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cd8 expref: 170 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.754585:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500838b lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cd8 expref: 169 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.754591:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee8:0x0].0x0 (ffff88009399e700) 00010000:00010000:2.0:1715205776.754593:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.754594:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fada1c0, rc 0) 00010000:00000080:2.0:1715205776.754598:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c17c0 x1798520455801152/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.754649:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+169:11754:x1798520455801152:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1288us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.754655:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2067 00000100:00100000:3.0:1715205776.756533:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.757456:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455801344 00000100:00100000:2.0:1715205776.757486:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2068 00000100:00100000:2.0:1715205776.757491:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d910850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+169:11754:x1798520455801344:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.757503:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.757515:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305008392 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23cdf expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.757570:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008399 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.757580:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305007b2d lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239b3 expref: 170 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.757589:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008399 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.757609:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305007b2d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239b3 expref: 170 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.757640:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305007b2d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239b3 expref: 170 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.757650:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6dec740 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040576:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.757695:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a9158240 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.759026:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.759076:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455801408 00010000:00010000:0.0:1715205776.759103:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305007b2d lrc: 5/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239b3 expref: 171 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.759135:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4848 00000100:00100000:0.0:1715205776.759140:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:1831:x1798520455801408:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1715205776.759150:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.759154:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305007b2d lrc: 5/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239b3 expref: 171 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.759161:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305007b2d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239b3 expref: 171 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.759178:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee9:0x0].0x0 (ffff88009399e100) 00010000:00010000:0.0:1715205776.759182:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008399 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.759192:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008399 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.759198:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008399 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.759211:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.759243:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70a0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:1831:x1798520455801408:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 103us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.759249:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4848 00010000:00010000:3.0:1715205776.759714:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305007b2d lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239b3 expref: 170 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.759743:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6dec740 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040576:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.759760:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008399 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.759770:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008399 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.759774:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008399 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205776.759786:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee9:0x0]: returning size 260096 00010000:00010000:3.0:1715205776.759879:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af4305008392 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cdf expref: 171 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.759891:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008399 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cdf expref: 170 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.759897:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee9:0x0].0x0 (ffff88009399e100) 00010000:00010000:3.0:1715205776.759898:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1715205776.759900:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fad86c0, rc 0) 00010000:00000080:3.0:1715205776.759903:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d910850 x1798520455801344/t330712482759(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.759934:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d910850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+170:11754:x1798520455801344:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2442us (3404us total) trans 330712482759 rc 0/0 00000100:00100000:3.0:1715205776.759941:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2068 00000100:00100000:3.0:1715205776.761830:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.761902:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455801472 00000100:00100000:2.0:1715205776.761935:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2069 00000100:00100000:2.0:1715205776.761947:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092749300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+170:11754:x1798520455801472:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.761962:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.761976:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af43050083a7 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23ce6 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.762004:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af43050083ae lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.762012:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008399 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cdf expref: 171 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.762015:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af43050083ae lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.762036:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008399 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cdf expref: 171 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.762042:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008399 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cdf expref: 171 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.762049:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6deb900 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040640:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.762081:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a9158c00 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.762935:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6deb900 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040640:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.762946:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af43050083ae lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.763179:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.763241:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455801536 00010000:00010000:0.0:1715205776.763254:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008399 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cdf expref: 172 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.763272:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4849 00000100:00100000:0.0:1715205776.763275:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009274b900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+172:1831:x1798520455801536:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205776.763280:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.763283:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008399 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cdf expref: 172 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.763288:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008399 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cdf expref: 172 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.763298:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008399 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cdf expref: 172 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.763305:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee9:0x0].0x0 (ffff88009399e100) 00010000:00010000:0.0:1715205776.763307:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af43050083ae lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.763311:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af43050083ae lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.763315:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af43050083ae lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.763327:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.763344:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009274b900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:1831:x1798520455801536:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 68us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.763347:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4849 00010000:00010000:2.0:1715205776.763350:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af43050083ae lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.763357:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af43050083ae lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.763381:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee9:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.763384:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.763394:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af43050083ae lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.763401:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af43050083ae lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.763413:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af43050083a7 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ce6 expref: 171 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.763436:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af43050083ae lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ce6 expref: 170 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.763444:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee9:0x0].0x0 (ffff88009399e100) 00010000:00010000:2.0:1715205776.763445:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.763447:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fadad00, rc 0) 00010000:00000080:2.0:1715205776.763450:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880092749300 x1798520455801472/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.763482:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092749300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+170:11754:x1798520455801472:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1542us (1653us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.763487:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2069 00000100:00100000:3.0:1715205776.764579:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.764641:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455801664 00000100:00100000:2.0:1715205776.764667:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2070 00000100:00100000:2.0:1715205776.764670:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092748e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+170:11754:x1798520455801664:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.764679:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.764687:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8480/0xb608af43050083b5 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23ced expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.764747:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050083bc lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.764755:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af4305007b73 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239cf expref: 171 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.764760:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050083bc lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.764779:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af4305007b73 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239cf expref: 171 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.764786:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af4305007b73 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239cf expref: 171 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.764795:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6deb900 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040704:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.764829:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a9158c00 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.766265:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6deb900 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040704:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.766281:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050083bc lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.766460:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.766512:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455801728 00010000:00010000:0.0:1715205776.766529:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af4305007b73 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239cf expref: 172 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.766558:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4850 00000100:00100000:0.0:1715205776.766563:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092749c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+172:1830:x1798520455801728:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1715205776.766574:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.766577:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af4305007b73 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239cf expref: 172 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.766584:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af4305007b73 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239cf expref: 172 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.766595:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af4305007b73 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239cf expref: 172 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.766608:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeea:0x0].0x0 (ffff88012e817a00) 00010000:00010000:0.0:1715205776.766611:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050083bc lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.766640:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050083bc lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.766647:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050083bc lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.766666:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205776.766685:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050083bc lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.766688:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092749c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:1830:x1798520455801728:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 124us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.766694:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4850 00010000:00010000:3.0:1715205776.766695:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050083bc lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205776.766706:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeea:0x0]: returning size 260096 00010000:00010000:3.0:1715205776.766811:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8480/0xb608af43050083b5 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ced expref: 172 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.766821:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050083bc lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ced expref: 171 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.766826:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeea:0x0].0x0 (ffff88012e817a00) 00010000:00010000:3.0:1715205776.766827:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1715205776.766829:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fad8900, rc 0) 00010000:00000080:3.0:1715205776.766832:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880092748e40 x1798520455801664/t330712482760(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.766867:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092748e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:11754:x1798520455801664:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2196us (2289us total) trans 330712482760 rc 0/0 00000100:00100000:3.0:1715205776.766872:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2070 00000100:00100000:3.0:1715205776.768113:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.768171:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455801792 00000100:00100000:2.0:1715205776.768193:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2071 00000100:00100000:2.0:1715205776.768196:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009274ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:11754:x1798520455801792:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.768209:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.768218:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af43050083ca lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23cf4 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.768248:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af43050083d1 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.768257:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050083bc lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ced expref: 172 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.768262:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af43050083d1 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.768280:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050083bc lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ced expref: 172 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.768287:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050083bc lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ced expref: 172 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.768295:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6deb900 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040768:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.768331:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a9158c00 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.769172:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6deb900 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040768:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.769187:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af43050083d1 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.769218:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.769236:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455801856 00010000:00010000:3.0:1715205776.769250:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050083bc lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ced expref: 173 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.769280:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4851 00000100:00100000:3.0:1715205776.769283:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6deed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+173:1830:x1798520455801856:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1715205776.769290:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.769293:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050083bc lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ced expref: 173 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.769299:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050083bc lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ced expref: 173 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.769310:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050083bc lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ced expref: 173 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.769319:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeea:0x0].0x0 (ffff88012e817a00) 00010000:00010000:3.0:1715205776.769321:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af43050083d1 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.769327:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af43050083d1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.769331:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af43050083d1 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.769352:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.769370:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af43050083d1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.769376:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af43050083d1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.769382:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6deed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+172:1830:x1798520455801856:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 98us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.769387:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4851 00000004:00200000:2.0:1715205776.769400:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeea:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.769403:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.769413:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af43050083d1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.769421:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af43050083d1 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.769435:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af43050083ca lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cf4 expref: 172 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.769445:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af43050083d1 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cf4 expref: 171 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.769454:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeea:0x0].0x0 (ffff88012e817a00) 00010000:00010000:2.0:1715205776.769456:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.769457:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fadb180, rc 0) 00010000:00000080:2.0:1715205776.769461:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009274ed40 x1798520455801792/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.769497:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009274ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:11754:x1798520455801792:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1299us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.769503:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2071 00000100:00100000:2.0:1715205776.771004:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.771046:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455801984 00000100:00100000:3.0:1715205776.771068:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2072 00000100:00100000:3.0:1715205776.771071:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6deb900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+171:11754:x1798520455801984:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.771081:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.771091:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af43050083d8 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23cfb expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.771142:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050083df lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.771152:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af43050079cf lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23927 expref: 172 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.771157:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050083df lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.771175:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af43050079cf lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23927 expref: 172 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.771183:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af43050079cf lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23927 expref: 172 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.771191:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009274a140 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040832:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.771230:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099b38cc0 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.772937:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.772966:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009274a140 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040832:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.772979:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050083df lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.773000:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455802048 00010000:00010000:3.0:1715205776.773013:0:6662:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af43050079cf lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23927 expref: 173 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.773046:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4852 00000100:00100000:3.0:1715205776.773049:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009274d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+173:1831:x1798520455802048:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205776.773057:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.773061:0:6662:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af43050079cf lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23927 expref: 173 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.773068:0:6662:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af43050079cf lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23927 expref: 173 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.773080:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98fc0/0xb608af43050079cf lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23927 expref: 173 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.773088:0:6662:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:3.0:1715205776.773091:0:6662:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050083df lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.773101:0:6662:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050083df lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.773107:0:6662:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050083df lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.773119:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205776.773138:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009274d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+172:1831:x1798520455802048:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 88us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.773144:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4852 00010000:00010000:3.0:1715205776.773157:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050083df lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.773162:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050083df lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205776.773173:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeec:0x0]: returning size 260096 00010000:00010000:3.0:1715205776.773377:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af43050083d8 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cfb expref: 173 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.773387:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050083df lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cfb expref: 172 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.773392:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:3.0:1715205776.773394:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1715205776.773395:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73af840, rc 0) 00010000:00000080:3.0:1715205776.773399:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6deb900 x1798520455801984/t330712482761(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.773418:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6deb900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+172:11754:x1798520455801984:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2346us (2416us total) trans 330712482761 rc 0/0 00000100:00100000:3.0:1715205776.773423:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2072 00000100:00100000:1.0:1715205776.774712:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.774783:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455802112 00000100:00100000:3.0:1715205776.774817:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2073 00000100:00100000:3.0:1715205776.774821:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f112f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+172:11754:x1798520455802112:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.774833:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.774841:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af43050083ed lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23d02 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.774873:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050083f4 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.775080:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050083df lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cfb expref: 173 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.775087:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050083f4 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.775110:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050083df lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cfb expref: 173 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.775118:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050083df lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cfb expref: 173 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.775127:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009274a140 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040896:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.775165:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099b38cc0 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.776022:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.776079:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455802176 00000100:00100000:2.0:1715205776.776089:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009274a140 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040896:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.776101:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050083f4 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.776112:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050083df lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cfb expref: 174 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.776138:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4853 00000100:00100000:0.0:1715205776.776143:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009274d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+174:1831:x1798520455802176:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205776.776155:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.776159:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050083df lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cfb expref: 174 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.776167:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050083df lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cfb expref: 174 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.776189:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af43050083df lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cfb expref: 174 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.776202:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:0.0:1715205776.776206:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050083f4 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.776214:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050083f4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.776220:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050083f4 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.776248:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.776272:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050083f4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.776278:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050083f4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.776296:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009274d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+173:1831:x1798520455802176:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 153us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.776302:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4853 00000004:00200000:2.0:1715205776.776302:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeec:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.776305:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.776316:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050083f4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.776324:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050083f4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.776343:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af43050083ed lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d02 expref: 173 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.776356:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050083f4 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d02 expref: 172 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.776362:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeec:0x0].0x0 (ffff88008f367a00) 00010000:00010000:2.0:1715205776.776363:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.776365:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ac480, rc 0) 00010000:00000080:2.0:1715205776.776368:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f112f80 x1798520455802112/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.776407:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f112f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+172:11754:x1798520455802112:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1585us (1696us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.776412:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2073 00000100:00100000:3.0:1715205776.777788:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.777856:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455802304 00000100:00100000:2.0:1715205776.777890:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2074 00000100:00100000:2.0:1715205776.777895:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009274cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+172:11754:x1798520455802304:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.777906:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.777916:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af43050083fb lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23d09 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.777966:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008402 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.777976:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050079f2 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23935 expref: 173 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.777985:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008402 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.778017:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050079f2 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23935 expref: 173 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.778025:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050079f2 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23935 expref: 173 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.778034:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6deda40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040960:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.778084:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a91580c0 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.779351:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6deda40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456040960:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.779366:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008402 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.779781:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.779856:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455802368 00010000:00010000:1.0:1715205776.779875:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050079f2 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23935 expref: 174 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.779904:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4854 00000100:00100000:1.0:1715205776.779908:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009274a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+174:1830:x1798520455802368:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1715205776.779917:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.779920:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050079f2 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23935 expref: 174 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.779928:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050079f2 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23935 expref: 174 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.779941:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9aac0/0xb608af43050079f2 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23935 expref: 174 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.779951:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeed:0x0].0x0 (ffff880092452f00) 00010000:00010000:1.0:1715205776.779954:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008402 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.779959:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008402 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.779964:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008402 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.779992:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205776.780018:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009274a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+173:1830:x1798520455802368:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 109us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.780030:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4854 00010000:00010000:2.0:1715205776.780445:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008402 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.780452:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008402 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.780466:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeed:0x0]: returning size 260096 00010000:00010000:2.0:1715205776.780565:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af43050083fb lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d09 expref: 174 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.780577:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008402 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d09 expref: 173 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.780587:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeed:0x0].0x0 (ffff880092452f00) 00010000:00010000:2.0:1715205776.780588:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.780590:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fad86c0, rc 0) 00010000:00000080:2.0:1715205776.780593:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009274cc00 x1798520455802304/t330712482762(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.780646:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009274cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+173:11754:x1798520455802304:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2750us (2860us total) trans 330712482762 rc 0/0 00000100:00100000:2.0:1715205776.780652:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2074 00000100:00100000:3.0:1715205776.782711:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.782798:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455802432 00000100:00100000:2.0:1715205776.782832:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2075 00000100:00100000:2.0:1715205776.782836:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ee880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+173:11754:x1798520455802432:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.782850:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.782862:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af4305008410 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23d10 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.782900:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305008417 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.782911:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008402 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d09 expref: 174 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.782916:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305008417 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.783413:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008402 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d09 expref: 174 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.783427:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008402 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d09 expref: 174 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.783436:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6deda40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041024:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.783482:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a91580c0 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.784540:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6deda40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041024:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.784554:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305008417 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.787099:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.787147:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455802496 00010000:00010000:1.0:1715205776.787170:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008402 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d09 expref: 175 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.787203:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4855 00000100:00100000:1.0:1715205776.787207:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129eba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+175:1831:x1798520455802496:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1715205776.787227:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.787232:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008402 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d09 expref: 175 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.787241:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008402 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d09 expref: 175 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.787256:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af4305008402 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d09 expref: 175 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.787266:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeed:0x0].0x0 (ffff880092452f00) 00010000:00010000:1.0:1715205776.787269:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305008417 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.787276:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305008417 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.787281:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305008417 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.787307:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.787326:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305008417 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.787332:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305008417 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.787344:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129eba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+174:1831:x1798520455802496:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 136us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.787353:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4855 00000004:00200000:2.0:1715205776.787356:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeed:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.787358:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.787367:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305008417 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.787372:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305008417 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.787386:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af4305008410 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d10 expref: 174 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.787393:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305008417 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d10 expref: 173 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.787397:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeed:0x0].0x0 (ffff880092452f00) 00010000:00010000:2.0:1715205776.787398:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.787399:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fad8240, rc 0) 00010000:00000080:2.0:1715205776.787403:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910ee880 x1798520455802432/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.787424:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ee880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+173:11754:x1798520455802432:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 4588us (4717us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.787430:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2075 00000100:00100000:3.0:1715205776.788813:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.788863:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455802624 00000100:00100000:0.0:1715205776.788914:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2076 00000100:00100000:0.0:1715205776.788919:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ed580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+173:11754:x1798520455802624:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.788936:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.788952:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af430500841e lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23d17 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.789024:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008425 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.789037:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007a15 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23943 expref: 174 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.789043:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008425 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.789070:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007a15 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23943 expref: 174 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.789079:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007a15 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23943 expref: 174 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.789089:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880134ad04c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041088:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.789145:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880129e0ef00 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.790170:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880134ad04c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041088:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.790188:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008425 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.790339:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.790415:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455802688 00010000:00010000:1.0:1715205776.790433:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007a15 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23943 expref: 175 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.790459:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4856 00000100:00100000:1.0:1715205776.790464:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ecc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+175:1830:x1798520455802688:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1715205776.790476:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.790480:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007a15 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23943 expref: 175 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.790488:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007a15 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23943 expref: 175 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.790503:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99680/0xb608af4305007a15 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23943 expref: 175 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.790511:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeee:0x0].0x0 (ffff8800b410f900) 00010000:00010000:1.0:1715205776.790513:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008425 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.790520:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008425 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.790529:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008425 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.790574:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.790595:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008425 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.790603:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008425 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.790614:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ecc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+174:1830:x1798520455802688:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 149us (275us total) trans 0 rc 0/0 00000004:00200000:0.0:1715205776.790634:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeee:0x0]: returning size 260096 00000100:00100000:1.0:1715205776.790637:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4856 00010000:00010000:0.0:1715205776.790761:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d440/0xb608af430500841e lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d17 expref: 175 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.790773:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008425 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d17 expref: 174 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.790778:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeee:0x0].0x0 (ffff8800b410f900) 00010000:00010000:0.0:1715205776.790780:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205776.790781:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83d8c0, rc 0) 00010000:00000080:0.0:1715205776.790786:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910ed580 x1798520455802624/t330712482763(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.790823:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ed580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+174:11754:x1798520455802624:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1904us (2012us total) trans 330712482763 rc 0/0 00000100:00100000:0.0:1715205776.790829:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2076 00000100:00100000:3.0:1715205776.791661:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.791693:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455802752 00000100:00100000:0.0:1715205776.791722:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2077 00000100:00100000:0.0:1715205776.791739:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ed0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+174:11754:x1798520455802752:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.791754:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.791763:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305008433 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23d1e expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.791794:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af430500843a lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.791802:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008425 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d17 expref: 175 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.791807:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af430500843a lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.791825:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008425 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d17 expref: 175 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.791833:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008425 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d17 expref: 175 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.791841:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880134ad50c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041152:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.791879:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880129e0e9c0 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.792922:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880134ad50c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041152:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.792924:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:1.0:1715205776.792935:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af430500843a lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.792948:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455802816 00010000:00010000:0.0:1715205776.792958:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008425 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d17 expref: 176 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.792980:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4857 00000100:00100000:0.0:1715205776.792983:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad5580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+176:1830:x1798520455802816:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205776.792996:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.792999:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008425 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d17 expref: 176 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.793008:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008425 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d17 expref: 176 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.793017:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d8c0/0xb608af4305008425 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d17 expref: 176 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.793024:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeee:0x0].0x0 (ffff8800b410f900) 00010000:00010000:0.0:1715205776.793027:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af430500843a lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.793031:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af430500843a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.793035:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af430500843a lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.793051:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.793067:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad5580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+175:1830:x1798520455802816:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 82us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.793072:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4857 00010000:00010000:1.0:1715205776.793087:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af430500843a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.793093:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af430500843a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205776.793115:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeee:0x0]: returning size 260096 00000004:00200000:1.0:1715205776.793118:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205776.793128:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af430500843a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.793136:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af430500843a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.793151:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305008433 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d1e expref: 175 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.793166:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af430500843a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d1e expref: 174 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.793170:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeee:0x0].0x0 (ffff8800b410f900) 00010000:00010000:1.0:1715205776.793172:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205776.793174:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83d680, rc 0) 00010000:00000080:1.0:1715205776.793177:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910ed0c0 x1798520455802752/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.793210:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ed0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+174:11754:x1798520455802752:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1483us (1549us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.793216:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2077 00000100:00100000:0.0:1715205776.794231:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.794270:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455802944 00000100:00100000:1.0:1715205776.794294:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2078 00000100:00100000:1.0:1715205776.794297:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+174:11754:x1798520455802944:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.794306:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.794314:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305008441 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23d25 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.794356:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008448 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.794363:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305007a38 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23951 expref: 175 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.794368:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008448 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.794387:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305007a38 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23951 expref: 175 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.794395:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305007a38 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23951 expref: 175 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.794403:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f117200 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041216:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.794438:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a641a780 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.795205:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f117200 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041216:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.795219:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008448 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.795333:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.795374:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455803008 00010000:00010000:1.0:1715205776.795386:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305007a38 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23951 expref: 176 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.795409:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4858 00000100:00100000:1.0:1715205776.795413:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad7200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+176:1830:x1798520455803008:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1715205776.795419:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.795422:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305007a38 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23951 expref: 176 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.795429:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305007a38 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23951 expref: 176 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.795439:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305007a38 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23951 expref: 176 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.795447:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeef:0x0].0x0 (ffff880129f26800) 00010000:00010000:1.0:1715205776.795449:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008448 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.795455:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008448 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.795459:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008448 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.795478:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.795491:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008448 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.795496:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008448 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.795500:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad7200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+175:1830:x1798520455803008:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 86us (170us total) trans 0 rc 0/0 00000004:00200000:2.0:1715205776.795504:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeef:0x0]: returning size 260096 00000100:00100000:1.0:1715205776.795505:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4858 00010000:00010000:2.0:1715205776.795575:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305008441 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d25 expref: 176 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.795581:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008448 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d25 expref: 175 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.795584:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeef:0x0].0x0 (ffff880129f26800) 00010000:00010000:2.0:1715205776.795585:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.795586:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59fcc0, rc 0) 00010000:00000080:2.0:1715205776.795588:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880134ad2600 x1798520455802944/t330712482764(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.795614:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad2600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+175:11754:x1798520455802944:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1317us (1385us total) trans 330712482764 rc 0/0 00000100:00100000:2.0:1715205776.795632:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2078 00000100:00100000:0.0:1715205776.796507:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.796552:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455803072 00000100:00100000:2.0:1715205776.796571:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2079 00000100:00100000:2.0:1715205776.796574:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad3440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+175:11754:x1798520455803072:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.796584:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.796592:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af4305008456 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23d2c expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.796635:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8480/0xb608af430500845d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.796644:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008448 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d25 expref: 176 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.796648:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8480/0xb608af430500845d lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.796665:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008448 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d25 expref: 176 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.796672:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008448 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d25 expref: 176 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.796679:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6deda40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041280:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.796713:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a91580c0 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.797676:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6deda40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041280:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.797679:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:2.0:1715205776.797690:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8480/0xb608af430500845d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.797759:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455803136 00010000:00010000:1.0:1715205776.797772:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008448 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d25 expref: 177 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.797802:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4859 00000100:00100000:1.0:1715205776.797806:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ef6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+177:1831:x1798520455803136:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1715205776.797813:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.797817:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008448 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d25 expref: 177 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.797828:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008448 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d25 expref: 177 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.797843:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008448 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d25 expref: 177 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.797852:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeef:0x0].0x0 (ffff880129f26800) 00010000:00010000:1.0:1715205776.797855:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8480/0xb608af430500845d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.797860:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8480/0xb608af430500845d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.797864:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8480/0xb608af430500845d lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.797888:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.797910:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8480/0xb608af430500845d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.797915:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ef6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+176:1831:x1798520455803136:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 108us (237us total) trans 0 rc 0/0 00010000:00010000:2.0:1715205776.797917:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8480/0xb608af430500845d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.797921:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4859 00000004:00200000:2.0:1715205776.797937:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeef:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.797939:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.797948:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8480/0xb608af430500845d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.797954:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8480/0xb608af430500845d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.797968:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af4305008456 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d2c expref: 176 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.797978:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8480/0xb608af430500845d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d2c expref: 175 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.797982:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeef:0x0].0x0 (ffff880129f26800) 00010000:00010000:2.0:1715205776.797983:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.797984:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fad8480, rc 0) 00010000:00000080:2.0:1715205776.797987:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880134ad3440 x1798520455803072/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.798011:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad3440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+175:11754:x1798520455803072:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1436us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.798015:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2079 00000100:00100000:3.0:1715205776.799035:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.799087:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455803264 00000100:00100000:2.0:1715205776.799114:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2080 00000100:00100000:2.0:1715205776.799118:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ea600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+175:11754:x1798520455803264:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.799127:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.799134:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af4305008464 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23d33 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.799178:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af430500846b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.799187:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af4305007a5b lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2395f expref: 176 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.799192:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af430500846b lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.799207:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af4305007a5b lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2395f expref: 176 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.799214:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af4305007a5b lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2395f expref: 176 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.799222:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6deda40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041344:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.799252:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a91580c0 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.799970:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6deda40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041344:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.799971:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:2.0:1715205776.799981:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af430500846b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.800004:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455803328 00010000:00010000:1.0:1715205776.800016:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af4305007a5b lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2395f expref: 177 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.800038:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4860 00000100:00100000:1.0:1715205776.800042:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ea140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+177:1831:x1798520455803328:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1715205776.800048:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.800050:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af4305007a5b lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2395f expref: 177 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.800062:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af4305007a5b lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2395f expref: 177 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.800071:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af4305007a5b lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2395f expref: 177 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.800078:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef0:0x0].0x0 (ffff88009c8aab00) 00010000:00010000:1.0:1715205776.800081:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af430500846b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.800085:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af430500846b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.800090:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af430500846b lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.800111:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205776.800133:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ea140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+176:1831:x1798520455803328:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 90us (163us total) trans 0 rc 0/0 00010000:00010000:2.0:1715205776.800133:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af430500846b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.800139:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4860 00010000:00010000:2.0:1715205776.800141:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af430500846b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.800150:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xef0:0x0]: returning size 260096 00010000:00010000:2.0:1715205776.800235:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada640/0xb608af4305008464 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d33 expref: 177 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.800245:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af430500846b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d33 expref: 176 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.800250:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef0:0x0].0x0 (ffff88009c8aab00) 00010000:00010000:2.0:1715205776.800252:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.800253:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fad8fc0, rc 0) 00010000:00000080:2.0:1715205776.800257:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910ea600 x1798520455803264/t330712482765(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.800286:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ea600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+176:11754:x1798520455803264:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1167us (1252us total) trans 330712482765 rc 0/0 00000100:00100000:2.0:1715205776.800292:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2080 00000100:00100000:3.0:1715205776.801256:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.801323:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455803392 00000100:00100000:2.0:1715205776.801350:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2081 00000100:00100000:2.0:1715205776.801354:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ebdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+176:11754:x1798520455803392:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.801368:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.801375:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af4305008479 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23d3a expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.801400:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305008480 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.801408:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af430500846b lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d33 expref: 177 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.801417:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305008480 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.801431:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af430500846b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d33 expref: 177 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.801438:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af430500846b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d33 expref: 177 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.801445:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6deda40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041408:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.801480:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a91580c0 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.802766:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6deda40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041408:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.802778:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305008480 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.803030:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.803079:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455803456 00010000:00010000:1.0:1715205776.803094:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af430500846b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d33 expref: 178 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.803119:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4861 00000100:00100000:1.0:1715205776.803122:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910eed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+178:1831:x1798520455803456:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1715205776.803129:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.803133:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af430500846b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d33 expref: 178 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.803140:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af430500846b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d33 expref: 178 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.803151:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8fc0/0xb608af430500846b lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d33 expref: 178 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.803160:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef0:0x0].0x0 (ffff88009c8aab00) 00010000:00010000:1.0:1715205776.803163:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305008480 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.803168:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305008480 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.803173:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305008480 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.803195:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205776.803217:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910eed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+177:1831:x1798520455803456:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 94us (188us total) trans 0 rc 0/0 00010000:00010000:2.0:1715205776.803219:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305008480 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.803222:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4861 00010000:00010000:2.0:1715205776.803226:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305008480 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.803248:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xef0:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.803251:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.803260:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305008480 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.803267:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305008480 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.803280:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad98c0/0xb608af4305008479 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d3a expref: 177 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.803290:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305008480 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d3a expref: 176 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.803295:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef0:0x0].0x0 (ffff88009c8aab00) 00010000:00010000:2.0:1715205776.803297:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.803298:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fad9200, rc 0) 00010000:00000080:2.0:1715205776.803301:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910ebdc0 x1798520455803392/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.803332:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ebdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+176:11754:x1798520455803392:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1978us (2081us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.803338:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2081 00000100:00100000:3.0:1715205776.804662:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.804711:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455803584 00000100:00100000:2.0:1715205776.804752:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2082 00000100:00100000:2.0:1715205776.804756:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910eb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+176:11754:x1798520455803584:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.804766:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.804774:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af4305008487 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23d41 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.804820:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af430500848e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.804829:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305007b50 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239c1 expref: 177 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.804834:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af430500848e lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.804849:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305007b50 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239c1 expref: 177 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.804857:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305007b50 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239c1 expref: 177 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.804864:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6deda40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041472:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.804897:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a91580c0 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.805669:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6deda40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041472:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.805683:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af430500848e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.806070:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.806118:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455803648 00010000:00010000:1.0:1715205776.806131:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305007b50 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239c1 expref: 178 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.806144:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4862 00000100:00100000:1.0:1715205776.806146:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+178:1830:x1798520455803648:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1715205776.806153:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.806155:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305007b50 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239c1 expref: 178 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.806160:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305007b50 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239c1 expref: 178 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.806168:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305007b50 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b239c1 expref: 178 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.806181:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeeb:0x0].0x0 (ffff88008f367f00) 00010000:00010000:1.0:1715205776.806184:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af430500848e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.806189:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af430500848e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.806194:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af430500848e lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.806218:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205776.806245:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+177:1830:x1798520455803648:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 97us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.806251:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4862 00010000:00010000:2.0:1715205776.806286:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af430500848e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.806292:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af430500848e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.806304:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeeb:0x0]: returning size 260096 00010000:00010000:2.0:1715205776.806400:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9d40/0xb608af4305008487 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d41 expref: 178 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.806414:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af430500848e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d41 expref: 177 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.806419:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeeb:0x0].0x0 (ffff88008f367f00) 00010000:00010000:2.0:1715205776.806420:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.806422:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fad8d80, rc 0) 00010000:00000080:2.0:1715205776.806425:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910eb440 x1798520455803584/t330712482766(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.806462:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910eb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+177:11754:x1798520455803584:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1705us (1800us total) trans 330712482766 rc 0/0 00000100:00100000:2.0:1715205776.806468:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2082 00000100:00100000:3.0:1715205776.807538:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.807608:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455803712 00000100:00100000:2.0:1715205776.807661:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2083 00000100:00100000:2.0:1715205776.807665:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ec280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+177:11754:x1798520455803712:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.807677:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.807685:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af430500849c lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23d48 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.807714:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af43050084a3 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.807741:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af430500848e lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d41 expref: 178 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.807746:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af43050084a3 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.807766:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af430500848e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d41 expref: 178 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.807860:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af430500848e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d41 expref: 178 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.807871:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6deda40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041536:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.808013:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a91580c0 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.808972:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6deda40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041536:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.808984:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:2.0:1715205776.808985:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af43050084a3 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.809027:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455803776 00010000:00010000:1.0:1715205776.809040:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af430500848e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d41 expref: 179 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.809065:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4863 00000100:00100000:1.0:1715205776.809069:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad1300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+179:1830:x1798520455803776:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1715205776.809075:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.809078:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af430500848e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d41 expref: 179 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.809084:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af430500848e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d41 expref: 179 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.809093:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8d80/0xb608af430500848e lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d41 expref: 179 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.809101:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeeb:0x0].0x0 (ffff88008f367f00) 00010000:00010000:1.0:1715205776.809103:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af43050084a3 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.809108:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af43050084a3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.809113:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af43050084a3 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.809137:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205776.809155:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad1300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+178:1830:x1798520455803776:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 86us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.809161:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4863 00010000:00010000:2.0:1715205776.809210:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af43050084a3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.809216:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af43050084a3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.809238:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeeb:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.809240:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.809250:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af43050084a3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.809256:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af43050084a3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.809268:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaf40/0xb608af430500849c lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d48 expref: 178 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.809281:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af43050084a3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d48 expref: 177 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.809285:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeeb:0x0].0x0 (ffff88008f367f00) 00010000:00010000:2.0:1715205776.809287:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.809288:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fadb3c0, rc 0) 00010000:00000080:2.0:1715205776.809291:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910ec280 x1798520455803712/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.809325:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ec280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+177:11754:x1798520455803712:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1659us (1788us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.809330:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2083 00000100:00100000:0.0:1715205776.810419:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.810452:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455803840 00000100:00100000:2.0:1715205776.810477:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2084 00000100:00100000:2.0:1715205776.810481:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+177:11754:x1798520455803840:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.810494:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.810502:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af43050084aa lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23d4f expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810526:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050084b1 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810533:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050084b1 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810539:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050084b1 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810551:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af43050084b8 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x554d0b88 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810555:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af43050084b8 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810560:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af43050084b8 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810736:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050084bf lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810742:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050084bf lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810747:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050084bf lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.810758:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xef1:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.810761:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.810767:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050084bf lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810773:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050084bf lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810778:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050084b1 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810782:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050084b1 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810787:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050084b1 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810791:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009fad8900 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.810793:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050084b1 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810797:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050084b1 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810802:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.810804:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.810806:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050084b1 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810809:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8900/0xb608af43050084b1 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810816:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af43050084b8 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810820:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af43050084b8 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810824:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af43050084b8 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810828:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009fad86c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.810829:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af43050084b8 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810833:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af43050084b8 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810838:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x554d0b88 (ffff8801336c2d00) 00010000:00010000:2.0:1715205776.810840:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.810841:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af43050084b8 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810844:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad86c0/0xb608af43050084b8 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810861:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8b40/0xb608af43050084aa lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d4f expref: 179 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810868:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050084bf lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d4f expref: 178 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.810872:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef1:0x0].0x0 (ffff8801336c2a00) 00010000:00010000:2.0:1715205776.810874:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.810875:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fadb600, rc 0) 00010000:00000080:2.0:1715205776.810877:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880134ad5580 x1798520455803840/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.810913:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+178:11754:x1798520455803840:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 431us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.810917:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2084 00000100:00100000:3.0:1715205776.812174:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.812246:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455803968 00000100:00100000:2.0:1715205776.812274:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2085 00000100:00100000:2.0:1715205776.812278:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910e8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+178:11754:x1798520455803968:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.812288:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.812296:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af43050084c6 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23d56 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.812340:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af43050084cd lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xef1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.812348:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af43050084cd lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xef1:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.812354:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af43050084cd lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xef1:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.812362:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xef1:0x0]: returning size 260096 00010000:00010000:2.0:1715205776.812441:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb840/0xb608af43050084c6 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d56 expref: 181 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.812451:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af43050084cd lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xef1:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d56 expref: 180 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.812457:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef1:0x0].0x0 (ffff8801336c2a00) 00010000:00010000:2.0:1715205776.812458:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1715205776.812459:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fada400, rc 0) 00010000:00000080:2.0:1715205776.812462:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910e8980 x1798520455803968/t330712482767(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.812496:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910e8980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+180:11754:x1798520455803968:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 218us (324us total) trans 330712482767 rc 0/0 00000100:00100000:2.0:1715205776.812505:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2085 00000100:00100000:3.0:1715205776.813665:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.813766:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455804032 00000100:00100000:2.0:1715205776.813784:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2086 00000100:00100000:2.0:1715205776.813786:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ec740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+180:11754:x1798520455804032:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.813794:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.813798:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af43050084db lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23d5d expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.813816:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050084e2 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.813821:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050084e2 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.813825:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050084e2 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.813831:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050084e9 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6ae51ddf bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.813834:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050084e9 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ae51ddf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.813836:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050084e9 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ae51ddf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.813870:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050084e2 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.813877:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050084e2 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.813882:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050084e2 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.813887:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedf3c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.813889:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050084e2 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.813893:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050084e2 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.813899:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.813901:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.813903:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050084e2 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.813906:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af43050084e2 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.813914:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050084e9 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ae51ddf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.813918:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050084e9 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ae51ddf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.813922:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050084e9 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ae51ddf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.813930:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eeddb00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.813932:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050084e9 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ae51ddf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.813936:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050084e9 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x6ae51ddf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.813941:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x6ae51ddf (ffff8801336c2300) 00010000:00010000:2.0:1715205776.813943:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.813944:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050084e9 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6ae51ddf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.813948:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af43050084e9 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x6ae51ddf bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.813972:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af43050084db lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d5d expref: 181 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.813977:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9680/0xb608af43050084db lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d5d expref: 181 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.813984:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009fad9680, rc 0) 00010000:00000080:2.0:1715205776.813987:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910ec740 x1798520455804032/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.814022:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ec740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+180:11754:x1798520455804032:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 234us (358us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205776.814027:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2086 00000100:00100000:0.0:1715205776.815077:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.815118:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455804096 00000100:00100000:2.0:1715205776.815134:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2087 00000100:00100000:2.0:1715205776.815137:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+180:11754:x1798520455804096:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.815144:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.815150:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af43050084f0 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23d64 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.815167:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af43050084f7 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.815173:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af43050084f7 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.815178:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af43050084f7 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.815186:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af43050084fe lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.815191:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af43050084fe lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.815195:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af43050084fe lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.815218:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af43050084f7 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.815223:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af43050084f7 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.815237:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af43050084f7 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.815240:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedfcc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.815242:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af43050084f7 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.815246:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af43050084f7 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.815251:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.815253:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.815254:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af43050084f7 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.815258:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af43050084f7 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.815264:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af43050084fe lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.815268:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af43050084fe lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.815271:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af43050084fe lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.815274:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedcb40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.815275:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af43050084fe lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.815279:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af43050084fe lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.815283:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x54f6b75a (ffff8801336c2400) 00010000:00010000:2.0:1715205776.815285:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.815286:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af43050084fe lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.815289:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af43050084fe lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.815312:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af43050084f0 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d64 expref: 181 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.815317:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af43050084f0 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d64 expref: 181 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.815322:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eede640, rc 0) 00010000:00000080:2.0:1715205776.815325:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880134ad7200 x1798520455804096/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.815359:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+180:11754:x1798520455804096:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 221us (284us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205776.815365:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2087 00000100:00100000:3.0:1715205776.816577:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.816650:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455804160 00000100:00100000:2.0:1715205776.816677:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2088 00000100:00100000:2.0:1715205776.816681:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910eaf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+180:11754:x1798520455804160:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.816690:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.816697:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af4305008505 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23d6b expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816718:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc480/0xb608af430500850c lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816741:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc480/0xb608af430500850c lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816749:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc480/0xb608af430500850c lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816758:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305008513 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xa149fd88 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816763:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305008513 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816767:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305008513 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816898:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af430500851a lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816902:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af430500851a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816906:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af430500851a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.816920:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xef2:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.816922:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.816929:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af430500851a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816933:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af430500851a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816936:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc480/0xb608af430500850c lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816939:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc480/0xb608af430500850c lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816941:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc480/0xb608af430500850c lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816944:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedc480 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.816945:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc480/0xb608af430500850c lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816947:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc480/0xb608af430500850c lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816951:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.816952:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.816953:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc480/0xb608af430500850c lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816955:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc480/0xb608af430500850c lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816961:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305008513 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816964:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305008513 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816966:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305008513 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816968:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedef40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.816969:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305008513 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816971:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305008513 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816974:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0xa149fd88 (ffff8801336c2e00) 00010000:00010000:2.0:1715205776.816975:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.816975:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305008513 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816977:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af4305008513 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816988:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af4305008505 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d6b expref: 182 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816993:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af430500851a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d6b expref: 181 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.816998:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef2:0x0].0x0 (ffff8801336c2f00) 00010000:00010000:2.0:1715205776.817000:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.817000:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedc000, rc 0) 00010000:00000080:2.0:1715205776.817002:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910eaf80 x1798520455804160/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.817029:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910eaf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+181:11754:x1798520455804160:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 348us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.817033:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2088 00000100:00100000:3.0:1715205776.818881:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.818948:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455804288 00000100:00100000:2.0:1715205776.818987:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2089 00000100:00100000:2.0:1715205776.818992:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ee3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+181:11754:x1798520455804288:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.819006:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.819019:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af4305008521 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23d72 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.819091:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008528 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.819102:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af430500851a lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d6b expref: 182 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.819108:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008528 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.819136:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af430500851a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d6b expref: 182 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.819151:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af430500851a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d6b expref: 182 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.819162:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6deda40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041600:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.819212:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a9158600 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.819916:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6deda40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041600:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.819936:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008528 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.820124:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.820177:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455804352 00010000:00010000:1.0:1715205776.820198:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af430500851a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d6b expref: 183 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.820233:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4864 00000100:00100000:1.0:1715205776.820237:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910e97c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+183:1831:x1798520455804352:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1715205776.820245:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.820248:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af430500851a lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d6b expref: 183 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.820256:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af430500851a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d6b expref: 183 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.820268:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af430500851a lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d6b expref: 183 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.820277:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef2:0x0].0x0 (ffff8801336c2f00) 00010000:00010000:1.0:1715205776.820280:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008528 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.820286:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008528 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.820291:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008528 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.820320:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.820349:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008528 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.820356:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008528 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.820359:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910e97c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+182:1831:x1798520455804352:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 122us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.820365:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4864 00000004:00200000:0.0:1715205776.820369:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xef2:0x0]: returning size 260096 00010000:00010000:0.0:1715205776.820462:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af4305008521 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d72 expref: 183 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.820474:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008528 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d72 expref: 182 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.820478:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef2:0x0].0x0 (ffff8801336c2f00) 00010000:00010000:0.0:1715205776.820480:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205776.820482:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedc6c0, rc 0) 00010000:00000080:0.0:1715205776.820485:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910ee3c0 x1798520455804288/t330712482768(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.820516:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ee3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+182:11754:x1798520455804288:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1524us (1641us total) trans 330712482768 rc 0/0 00000100:00100000:0.0:1715205776.820522:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2089 00000100:00100000:3.0:1715205776.821609:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.821665:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455804416 00000100:00100000:0.0:1715205776.821703:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2090 00000100:00100000:0.0:1715205776.821707:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+182:11754:x1798520455804416:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.821722:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.821745:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305008536 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23d79 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.821780:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af430500853d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.821788:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008528 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d72 expref: 183 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.821793:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af430500853d lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.821810:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008528 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d72 expref: 183 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.821817:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008528 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d72 expref: 183 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.821825:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880134ad50c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041664:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.821864:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880129e0e9c0 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.822851:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880134ad50c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041664:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.822868:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af430500853d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.823190:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.823230:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455804480 00010000:00010000:1.0:1715205776.823247:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008528 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d72 expref: 184 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.823265:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4865 00000100:00100000:1.0:1715205776.823269:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910e84c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+184:1831:x1798520455804480:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1715205776.823278:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.823281:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008528 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d72 expref: 184 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.823288:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008528 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d72 expref: 184 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.823300:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008528 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d72 expref: 184 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.823308:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef2:0x0].0x0 (ffff8801336c2f00) 00010000:00010000:1.0:1715205776.823311:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af430500853d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.823317:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af430500853d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.823322:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af430500853d lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.823344:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205776.823367:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910e84c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+183:1831:x1798520455804480:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 97us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.823372:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4865 00010000:00010000:2.0:1715205776.823420:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af430500853d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.823426:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af430500853d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.823449:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xef2:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.823452:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.823463:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af430500853d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.823470:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af430500853d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.823485:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305008536 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d79 expref: 183 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.823496:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af430500853d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d79 expref: 182 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.823501:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef2:0x0].0x0 (ffff8801336c2f00) 00010000:00010000:2.0:1715205776.823503:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.823504:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83dd40, rc 0) 00010000:00000080:2.0:1715205776.823508:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910eda40 x1798520455804416/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.823565:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+182:11754:x1798520455804416:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1856us (1965us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.823570:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2090 00000100:00100000:3.0:1715205776.824901:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.824980:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455804544 00000100:00100000:2.0:1715205776.825014:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2091 00000100:00100000:2.0:1715205776.825018:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910e9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+182:11754:x1798520455804544:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.825029:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.825039:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af4305008544 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23d80 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.825069:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af430500854b lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.825077:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af430500854b lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.825083:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af430500854b lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.825093:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305008552 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.825101:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305008552 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.825106:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305008552 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.825155:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af430500854b lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.825160:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af430500854b lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.825165:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af430500854b lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.825169:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedfa80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.825171:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af430500854b lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.825175:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af430500854b lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.825181:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.825182:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.825184:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af430500854b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.825188:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af430500854b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.825199:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305008552 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.825203:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305008552 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.825207:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305008552 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.825211:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eede1c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.825212:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305008552 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.825215:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305008552 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.825219:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x54f6b75a (ffff8801336c2c00) 00010000:00010000:2.0:1715205776.825220:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.825221:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305008552 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.825225:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af4305008552 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.825249:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af4305008544 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d80 expref: 183 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.825253:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af4305008544 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d80 expref: 183 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.825259:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedc900, rc 0) 00010000:00000080:2.0:1715205776.825262:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910e9300 x1798520455804544/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.825295:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910e9300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+182:11754:x1798520455804544:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 277us (397us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205776.825301:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2091 00000100:00100000:0.0:1715205776.826317:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.826371:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455804608 00000100:00100000:2.0:1715205776.826393:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2092 00000100:00100000:2.0:1715205776.826396:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+182:11754:x1798520455804608:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.826403:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.826410:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610900/0xb608af4305008559 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23d87 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.826423:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a612d00/0xb608af4305008560 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.826430:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a612d00/0xb608af4305008560 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.826436:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a612d00/0xb608af4305008560 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.826486:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610900/0xb608af4305008559 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d87 expref: 184 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.826501:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a612d00/0xb608af4305008560 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d87 expref: 183 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.826507:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:2.0:1715205776.826509:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1715205776.826511:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009a612d00, rc 0) 00010000:00000080:2.0:1715205776.826513:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880134ad04c0 x1798520455804608/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 568/1160 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.826543:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad04c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+183:11754:x1798520455804608:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 146us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.826549:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2092 00000100:00100000:3.0:1715205776.827872:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.827945:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455804672 00000100:00100000:2.0:1715205776.827971:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2093 00000100:00100000:2.0:1715205776.827975:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910e9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+183:11754:x1798520455804672:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.827982:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.827990:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a611d40/0xb608af4305008567 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23d8e expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.828003:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a611f80/0xb608af430500856e lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.828011:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a611f80/0xb608af430500856e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.828017:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a611f80/0xb608af430500856e lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.828060:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a611d40/0xb608af4305008567 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d8e expref: 185 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.828073:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a611f80/0xb608af430500856e lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d8e expref: 184 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.828078:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee5:0x0].0x0 (ffff8800a5d65a00) 00010000:00010000:2.0:1715205776.828080:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1715205776.828081:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009a611f80, rc 0) 00010000:00000080:2.0:1715205776.828084:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910e9c80 x1798520455804672/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 568/1160 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.828116:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910e9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+184:11754:x1798520455804672:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 140us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.828122:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2093 00000100:00100000:3.0:1715205776.829165:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.829224:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455804736 00000100:00100000:2.0:1715205776.829248:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2094 00000100:00100000:2.0:1715205776.829252:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910eb900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+184:11754:x1798520455804736:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.829259:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.829266:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a611b00/0xb608af4305008575 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23d95 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829289:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610b40/0xb608af430500857c lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829296:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610b40/0xb608af430500857c lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829303:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610b40/0xb608af430500857c lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829315:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613840/0xb608af4305008583 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x86398c8e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829320:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613840/0xb608af4305008583 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829324:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613840/0xb608af4305008583 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829467:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613600/0xb608af430500858a lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829473:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613600/0xb608af430500858a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829478:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613600/0xb608af430500858a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.829492:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xef3:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.829494:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.829499:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613600/0xb608af430500858a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829504:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613600/0xb608af430500858a lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829508:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610b40/0xb608af430500857c lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829510:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610b40/0xb608af430500857c lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829513:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610b40/0xb608af430500857c lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829516:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009a610b40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.829518:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610b40/0xb608af430500857c lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829522:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610b40/0xb608af430500857c lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829526:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.829527:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.829528:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610b40/0xb608af430500857c lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829530:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610b40/0xb608af430500857c lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829535:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613840/0xb608af4305008583 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829537:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613840/0xb608af4305008583 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829540:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613840/0xb608af4305008583 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829542:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009a613840 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.829543:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613840/0xb608af4305008583 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829546:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613840/0xb608af4305008583 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829549:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x86398c8e (ffff8801336c2000) 00010000:00010000:2.0:1715205776.829550:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.829550:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613840/0xb608af4305008583 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829552:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613840/0xb608af4305008583 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829564:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a611b00/0xb608af4305008575 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d95 expref: 186 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829568:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613600/0xb608af430500858a lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d95 expref: 185 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.829571:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef3:0x0].0x0 (ffff8801336c2100) 00010000:00010000:2.0:1715205776.829572:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.829572:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009a613600, rc 0) 00010000:00000080:2.0:1715205776.829574:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910eb900 x1798520455804736/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.829602:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910eb900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+185:11754:x1798520455804736:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 350us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.829606:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2094 00000100:00100000:0.0:1715205776.830748:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.830796:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455804864 00000100:00100000:2.0:1715205776.830812:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2095 00000100:00100000:2.0:1715205776.830815:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad3dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+185:11754:x1798520455804864:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.830821:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.830826:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a611440/0xb608af4305008591 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23d9c expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.830854:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610480/0xb608af4305008598 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xef3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.830859:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610480/0xb608af4305008598 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xef3:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.830863:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610480/0xb608af4305008598 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xef3:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.830867:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xef3:0x0]: returning size 260096 00010000:00010000:2.0:1715205776.830943:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a611440/0xb608af4305008591 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d9c expref: 188 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.830952:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610480/0xb608af4305008598 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xef3:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d9c expref: 187 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.830956:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef3:0x0].0x0 (ffff8801336c2100) 00010000:00010000:2.0:1715205776.830957:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1715205776.830958:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009a610480, rc 0) 00010000:00000080:2.0:1715205776.830960:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880134ad3dc0 x1798520455804864/t330712482769(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.830993:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad3dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:11754:x1798520455804864:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 174us (248us total) trans 330712482769 rc 0/0 00000100:00100000:2.0:1715205776.830999:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2095 00000100:00100000:3.0:1715205776.833120:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.833179:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455804928 00000100:00100000:2.0:1715205776.833218:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2096 00000100:00100000:2.0:1715205776.833224:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ecc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:11754:x1798520455804928:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.833240:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.833253:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610000/0xb608af43050085a6 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23da3 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.833292:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613a80/0xb608af43050085ad lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.833302:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613a80/0xb608af43050085ad lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.833311:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613a80/0xb608af43050085ad lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.833322:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610d80/0xb608af43050085b4 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.833327:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610d80/0xb608af43050085b4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.833332:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610d80/0xb608af43050085b4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.833386:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613a80/0xb608af43050085ad lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.833396:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613a80/0xb608af43050085ad lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.833401:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613a80/0xb608af43050085ad lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.833406:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009a613a80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.833410:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613a80/0xb608af43050085ad lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.833414:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613a80/0xb608af43050085ad lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.833422:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.833423:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.833425:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613a80/0xb608af43050085ad lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.833429:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613a80/0xb608af43050085ad lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.833437:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610d80/0xb608af43050085b4 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.833442:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610d80/0xb608af43050085b4 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.833446:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610d80/0xb608af43050085b4 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.833454:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009a610d80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.833456:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610d80/0xb608af43050085b4 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.833460:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610d80/0xb608af43050085b4 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.833464:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x54f6b75a (ffff8801336c2e00) 00010000:00010000:2.0:1715205776.833466:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.833467:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610d80/0xb608af43050085b4 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.833472:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610d80/0xb608af43050085b4 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.833501:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610000/0xb608af43050085a6 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23da3 expref: 188 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.833507:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610000/0xb608af43050085a6 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23da3 expref: 188 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.833514:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009a610000, rc 0) 00010000:00000080:2.0:1715205776.833518:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910ecc00 x1798520455804928/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.833562:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ecc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:11754:x1798520455804928:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 338us (443us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205776.833568:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2096 00000100:00100000:3.0:1715205776.834655:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.834703:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455804992 00000100:00100000:2.0:1715205776.834742:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2097 00000100:00100000:2.0:1715205776.834746:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ef6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:11754:x1798520455804992:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.834754:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.834762:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613180/0xb608af43050085bb lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23daa expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.834787:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a6133c0/0xb608af43050085c2 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.834793:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a6133c0/0xb608af43050085c2 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.834799:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a6133c0/0xb608af43050085c2 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.834808:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610fc0/0xb608af43050085c9 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.834813:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610fc0/0xb608af43050085c9 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.834817:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610fc0/0xb608af43050085c9 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.834846:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a6133c0/0xb608af43050085c2 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.834851:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a6133c0/0xb608af43050085c2 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.834860:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a6133c0/0xb608af43050085c2 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.834865:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009a6133c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.834867:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a6133c0/0xb608af43050085c2 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.834871:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a6133c0/0xb608af43050085c2 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.834877:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.834879:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.834881:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a6133c0/0xb608af43050085c2 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.834885:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a6133c0/0xb608af43050085c2 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.834893:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610fc0/0xb608af43050085c9 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.834897:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610fc0/0xb608af43050085c9 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.834900:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610fc0/0xb608af43050085c9 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.834904:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009a610fc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.834905:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610fc0/0xb608af43050085c9 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.834910:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610fc0/0xb608af43050085c9 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.834915:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x54f6b75a (ffff8801336c2300) 00010000:00010000:2.0:1715205776.834917:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.834918:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610fc0/0xb608af43050085c9 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.834922:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610fc0/0xb608af43050085c9 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.834948:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613180/0xb608af43050085bb lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23daa expref: 188 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.834954:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613180/0xb608af43050085bb lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23daa expref: 188 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.834960:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009a613180, rc 0) 00010000:00000080:2.0:1715205776.834963:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910ef6c0 x1798520455804992/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.834997:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ef6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:11754:x1798520455804992:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 250us (343us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205776.835002:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2097 00000100:00100000:0.0:1715205776.835910:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.835945:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455805056 00000100:00100000:2.0:1715205776.835958:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2098 00000100:00100000:2.0:1715205776.835961:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:11754:x1798520455805056:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.835968:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.835973:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a6121c0/0xb608af43050085d0 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23db1 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.835990:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af43050085d7 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.835994:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af43050085d7 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.835999:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af43050085d7 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.836004:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050085de lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.836008:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050085de lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.836011:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050085de lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.836030:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af43050085d7 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.836033:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af43050085d7 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.836036:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af43050085d7 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.836042:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedf600 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.836043:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af43050085d7 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.836046:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af43050085d7 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.836049:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.836050:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.836051:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af43050085d7 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.836054:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf600/0xb608af43050085d7 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.836059:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050085de lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.836062:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050085de lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.836064:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050085de lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.836066:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedef40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.836067:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050085de lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.836069:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050085de lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.836073:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x51a48d55 (ffff8801336c2200) 00010000:00010000:2.0:1715205776.836074:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.836075:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050085de lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.836077:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedef40/0xb608af43050085de lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.836090:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a6121c0/0xb608af43050085d0 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23db1 expref: 188 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.836093:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a6121c0/0xb608af43050085d0 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23db1 expref: 188 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.836096:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009a6121c0, rc 0) 00010000:00000080:2.0:1715205776.836098:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880134ad2f80 x1798520455805056/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.836127:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:11754:x1798520455805056:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 165us (219us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205776.836130:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2098 00000100:00100000:3.0:1715205776.836962:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.836998:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455805120 00000100:00100000:2.0:1715205776.837019:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2099 00000100:00100000:2.0:1715205776.837022:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ea140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:11754:x1798520455805120:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.837028:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.837033:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc480/0xb608af43050085e5 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23db8 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.837053:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af43050085ec lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.837058:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af43050085ec lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.837062:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af43050085ec lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.837068:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af43050085f3 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.837071:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af43050085f3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.837074:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af43050085f3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.837094:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af43050085ec lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.837096:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af43050085ec lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.837099:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af43050085ec lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.837102:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eede640 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.837103:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af43050085ec lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.837107:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af43050085ec lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.837111:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.837112:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.837113:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af43050085ec lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.837115:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede640/0xb608af43050085ec lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.837120:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af43050085f3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.837122:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af43050085f3 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.837124:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af43050085f3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.837126:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedcb40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.837127:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af43050085f3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.837130:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af43050085f3 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.837132:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x51f18c57 (ffff8801336c2600) 00010000:00010000:2.0:1715205776.837133:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.837134:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af43050085f3 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.837137:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcb40/0xb608af43050085f3 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.837152:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc480/0xb608af43050085e5 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23db8 expref: 188 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.837155:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc480/0xb608af43050085e5 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23db8 expref: 188 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.837159:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedc480, rc 0) 00010000:00000080:2.0:1715205776.837161:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910ea140 x1798520455805120/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.837186:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ea140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:11754:x1798520455805120:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 163us (226us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205776.837190:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2099 00000100:00100000:3.0:1715205776.838938:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.839002:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455805248 00000100:00100000:2.0:1715205776.839040:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2100 00000100:00100000:2.0:1715205776.839045:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910eed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:11754:x1798520455805248:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.839057:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.839070:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af43050085fa lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23dbf expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.839147:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af4305008601 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.839158:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af4305008601 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.839167:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af4305008601 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.839176:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af4305008608 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.839181:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af4305008608 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.839186:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af4305008608 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.839216:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af4305008601 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.839222:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af4305008601 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.839227:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af4305008601 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.839231:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eeddb00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.839234:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af4305008601 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.839238:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af4305008601 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.839245:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.839248:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.839250:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af4305008601 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.839254:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddb00/0xb608af4305008601 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.839262:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af4305008608 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.839265:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af4305008608 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.839269:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af4305008608 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.839272:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedf3c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.839273:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af4305008608 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.839277:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af4305008608 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.839281:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x51f18c57 (ffff8801336c2400) 00010000:00010000:2.0:1715205776.839282:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.839283:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af4305008608 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.839286:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf3c0/0xb608af4305008608 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.839310:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af43050085fa lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23dbf expref: 188 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.839314:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfcc0/0xb608af43050085fa lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23dbf expref: 188 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.839318:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedfcc0, rc 0) 00010000:00000080:2.0:1715205776.839321:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910eed40 x1798520455805248/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 656/600 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.839359:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910eed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:11754:x1798520455805248:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 315us (427us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205776.839363:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2100 00000100:00100000:0.0:1715205776.840150:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.840192:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455805312 00000100:00100000:2.0:1715205776.840205:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2101 00000100:00100000:2.0:1715205776.840207:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:11754:x1798520455805312:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.840213:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.840219:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af430500860f lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23dc6 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.840240:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008616 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.840245:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008616 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.840251:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008616 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.840259:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af430500861d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.840264:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af430500861d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.840269:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af430500861d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.840301:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008616 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.840306:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008616 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.840310:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008616 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.840314:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedc6c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.840316:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008616 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.840320:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008616 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.840326:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.840328:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.840329:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008616 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.840338:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc6c0/0xb608af4305008616 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.840344:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af430500861d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.840349:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af430500861d lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.840353:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af430500861d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.840357:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedc000 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.840358:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af430500861d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.840362:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af430500861d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.840367:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x51a48d55 (ffff8801336c2d00) 00010000:00010000:2.0:1715205776.840369:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.840370:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af430500861d lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.840374:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc000/0xb608af430500861d lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.840399:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af430500860f lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23dc6 expref: 188 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.840408:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedeac0/0xb608af430500860f lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23dc6 expref: 188 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.840413:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedeac0, rc 0) 00010000:00000080:2.0:1715205776.840415:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880134ad76c0 x1798520455805312/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.840443:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad76c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:11754:x1798520455805312:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 234us (294us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205776.840448:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2101 00000100:00100000:3.0:1715205776.841278:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.841315:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455805440 00000100:00100000:2.0:1715205776.841343:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2102 00000100:00100000:2.0:1715205776.841347:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d446d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:11754:x1798520455805440:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.841354:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.841360:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af4305008624 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23dcd expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.841394:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af430500862b lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.841400:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af430500862b lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.841404:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af430500862b lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.841409:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af4305008632 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.841413:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af4305008632 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.841416:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af4305008632 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.841432:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af430500862b lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.841436:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af430500862b lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.841440:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af430500862b lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.841443:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eede1c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.841445:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af430500862b lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.841449:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af430500862b lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.841454:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.841456:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.841457:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af430500862b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.841461:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eede1c0/0xb608af430500862b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.841471:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af4305008632 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.841476:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af4305008632 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.841480:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af4305008632 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.841483:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009eedfa80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.841485:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af4305008632 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.841489:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af4305008632 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.841494:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x51a48d55 (ffff8800a5e7a600) 00010000:00010000:2.0:1715205776.841495:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.841497:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af4305008632 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.841501:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedfa80/0xb608af4305008632 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.841518:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af4305008624 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23dcd expref: 188 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.841523:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc900/0xb608af4305008624 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23dcd expref: 188 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.841529:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009eedc900, rc 0) 00010000:00000080:2.0:1715205776.841531:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d446d40 x1798520455805440/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 656/600 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.841557:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d446d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:11754:x1798520455805440:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 210us (281us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205776.841560:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2102 00000100:00100000:3.0:1715205776.842296:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.842334:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455805504 00000100:00100000:2.0:1715205776.842357:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2103 00000100:00100000:2.0:1715205776.842360:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d447200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:11754:x1798520455805504:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.842366:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.842372:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091379680/0xb608af4305008639 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23dd4 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.842391:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009137b600/0xb608af4305008640 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.842396:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009137b600/0xb608af4305008640 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.842402:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009137b600/0xb608af4305008640 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.842410:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009137aac0/0xb608af4305008647 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.842414:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009137aac0/0xb608af4305008647 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.842422:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009137aac0/0xb608af4305008647 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.842446:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009137b600/0xb608af4305008640 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.842451:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009137b600/0xb608af4305008640 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.842455:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009137b600/0xb608af4305008640 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.842459:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009137b600 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.842461:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009137b600/0xb608af4305008640 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.842465:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009137b600/0xb608af4305008640 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.842471:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.842472:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.842474:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009137b600/0xb608af4305008640 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.842477:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009137b600/0xb608af4305008640 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.842485:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009137aac0/0xb608af4305008647 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.842493:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009137aac0/0xb608af4305008647 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.842498:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009137aac0/0xb608af4305008647 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.842501:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009137aac0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.842502:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009137aac0/0xb608af4305008647 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.842506:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009137aac0/0xb608af4305008647 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.842512:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x51f18c57 (ffff880091e4c800) 00010000:00010000:2.0:1715205776.842513:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.842514:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009137aac0/0xb608af4305008647 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.842518:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009137aac0/0xb608af4305008647 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.842545:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091379680/0xb608af4305008639 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23dd4 expref: 188 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.842548:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091379680/0xb608af4305008639 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23dd4 expref: 188 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.842553:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880091379680, rc 0) 00010000:00000080:2.0:1715205776.842556:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d447200 x1798520455805504/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.842579:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d447200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:11754:x1798520455805504:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 219us (285us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205776.842582:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2103 00000100:00100000:0.0:1715205776.843329:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.843394:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455805632 00000100:00100000:2.0:1715205776.843409:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2104 00000100:00100000:2.0:1715205776.843413:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:11754:x1798520455805632:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.843419:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.843425:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009137a400/0xb608af430500864e lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23ddb expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.843455:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009137b180/0xb608af4305008655 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.843462:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009137b180/0xb608af4305008655 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.843468:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009137b180/0xb608af4305008655 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.843474:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091379b00/0xb608af430500865c lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.843479:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091379b00/0xb608af430500865c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.843483:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091379b00/0xb608af430500865c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.843507:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009137b180/0xb608af4305008655 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.843511:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009137b180/0xb608af4305008655 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.843515:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009137b180/0xb608af4305008655 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.843518:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009137b180 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.843519:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009137b180/0xb608af4305008655 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.843523:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009137b180/0xb608af4305008655 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.843529:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.843530:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.843531:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009137b180/0xb608af4305008655 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.843535:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009137b180/0xb608af4305008655 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.843540:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091379b00/0xb608af430500865c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.843544:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091379b00/0xb608af430500865c lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.843551:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091379b00/0xb608af430500865c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.843554:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880091379b00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.843555:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091379b00/0xb608af430500865c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.843560:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091379b00/0xb608af430500865c lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.843565:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x51f18c57 (ffff880091e4c700) 00010000:00010000:2.0:1715205776.843567:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.843568:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091379b00/0xb608af430500865c lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.843572:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091379b00/0xb608af430500865c lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x51f18c57 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.843587:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009137a400/0xb608af430500864e lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ddb expref: 188 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.843591:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009137a400/0xb608af430500864e lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ddb expref: 188 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.843596:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009137a400, rc 0) 00010000:00000080:2.0:1715205776.843599:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880134ad2140 x1798520455805632/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 656/600 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.843636:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:11754:x1798520455805632:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 222us (307us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205776.843641:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2104 00000100:00100000:3.0:1715205776.844401:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.844439:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455805696 00000100:00100000:2.0:1715205776.844464:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2105 00000100:00100000:2.0:1715205776.844467:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d441c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:11754:x1798520455805696:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.844474:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.844480:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091379f80/0xb608af4305008663 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23de2 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.844500:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091379d40/0xb608af430500866a lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.844507:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091379d40/0xb608af430500866a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.844512:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091379d40/0xb608af430500866a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.844520:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913786c0/0xb608af4305008671 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.844525:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800913786c0/0xb608af4305008671 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.844530:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913786c0/0xb608af4305008671 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.844555:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091379d40/0xb608af430500866a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.844563:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091379d40/0xb608af430500866a lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.844567:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091379d40/0xb608af430500866a lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.844571:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880091379d40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.844572:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091379d40/0xb608af430500866a lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.844577:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091379d40/0xb608af430500866a lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.844583:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:2.0:1715205776.844585:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.844586:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091379d40/0xb608af430500866a lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.844590:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091379d40/0xb608af430500866a lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.844598:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800913786c0/0xb608af4305008671 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.844602:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800913786c0/0xb608af4305008671 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.844606:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800913786c0/0xb608af4305008671 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.844613:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800913786c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.844615:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913786c0/0xb608af4305008671 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.844636:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800913786c0/0xb608af4305008671 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.844642:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x51a48d55 (ffff880091e4c600) 00010000:00010000:2.0:1715205776.844644:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.844645:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800913786c0/0xb608af4305008671 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.844649:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913786c0/0xb608af4305008671 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.844678:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091379f80/0xb608af4305008663 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23de2 expref: 188 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.844684:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091379f80/0xb608af4305008663 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23de2 expref: 188 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.844690:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880091379f80, rc 0) 00010000:00000080:2.0:1715205776.844693:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d441c80 x1798520455805696/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.844739:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d441c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:11754:x1798520455805696:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 257us (325us total) trans 0 rc 301/301 00000100:00100000:2.0:1715205776.844744:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2105 00000100:00100000:3.0:1715205776.845811:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.845844:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455805824 00000100:00100000:0.0:1715205776.845867:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2106 00000100:00100000:0.0:1715205776.845869:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d442140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+187:11754:x1798520455805824:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.845875:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.845876:0:14860:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1715205776.845885:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cfc0/0xb608af4305008170 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c06 expref: 187 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.845892:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.845893:0:14860:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.845896:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305008678 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23de9 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.845945:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af430500867f lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.845952:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af430500867f lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.845959:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af430500867f lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.845967:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305008686 lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.845972:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305008686 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.845977:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305008686 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1715205776.846308:0:14860:0:(osp_object.c:1645:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x100010000:0x15dd:0x0], index 1: 0 00010000:00010000:0.0:1715205776.846418:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af430500868d lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.846425:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af430500868d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.846431:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af430500868d lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.846451:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af430500867f lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.846456:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af430500867f lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.846460:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af430500867f lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.846464:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83f840 already unused, calling callback (ffffffffa1341360) 00010000:00010000:0.0:1715205776.846465:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af430500867f lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.846474:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af430500867f lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.846479:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:0.0:1715205776.846481:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1715205776.846482:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af430500867f lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.846486:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f840/0xb608af430500867f lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1715205776.846494:0:14860:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88012d442140 reply state ffff880091f91000 transno 330712482770 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305008686 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.846509:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af4305008678 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23de9 expref: 189 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.846516:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af430500868d lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23de9 expref: 188 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.846521:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1018:0x0].0x0 (ffff880129cf6d00) 00010000:00010000:0.0:1715205776.846522:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1715205776.846523:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83df80, rc 0) 00010000:00000080:0.0:1715205776.846525:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d442140 x1798520455805824/t330712482770(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 656/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.846560:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d442140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+189:11754:x1798520455805824:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 689us (751us total) trans 330712482770 rc 0/0 00000100:00100000:0.0:1715205776.846569:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2106 00010000:00010000:1.0:1715205776.847076:0:2837:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305008686 lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.847082:0:2837:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305008686 lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.847085:0:2837:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305008686 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.847087:0:2837:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83e400 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.847088:0:2837:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305008686 lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.847091:0:2837:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305008686 lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.847096:0:2837:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x51a48d55 (ffff880129cf6500) 00010000:00010000:1.0:1715205776.847097:0:2837:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.847098:0:2837:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305008686 lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.847100:0:2837:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e400/0xb608af4305008686 lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.847507:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.847552:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455805888 00000100:00100000:0.0:1715205776.847578:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2107 00000100:00100000:0.0:1715205776.847582:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d445580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+188:11754:x1798520455805888:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.847590:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.847596:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af430500869b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23df0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.847633:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af43050086a2 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.847639:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af43050086a2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.847645:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af43050086a2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.847658:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205776.847664:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af43050086a2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.847668:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af43050086a2 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.847679:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af430500869b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23df0 expref: 190 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.847687:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af43050086a2 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23df0 expref: 189 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.847695:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1018:0x0].0x0 (ffff880129cf6d00) 00010000:00010000:0.0:1715205776.847697:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205776.847698:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83fa80, rc 0) 00010000:00000080:0.0:1715205776.847701:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d445580 x1798520455805888/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.847740:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d445580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+189:11754:x1798520455805888:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 157us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.847745:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2107 00000100:00100000:0.0:1715205776.848324:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.848362:0:19961:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455805952 00000100:00100000:3.0:1715205776.848400:0:19961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14704 00000100:00100000:3.0:1715205776.848402:0:19961:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad5f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+45:1830:x1798520455805952:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.848408:0:19961:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.848416:0:19961:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a73ae880/0xb608af43050086a9 lrc: 2/0,0 mode: --/PR res: [0x15dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23df7 expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1715205776.848428:0:19961:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x100010000:0x15dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1715205776.848435:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205776.848436:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205776.848439:0:19961:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a73ae880/0xb608af43050086a9 lrc: 3/0,0 mode: PR/PR res: [0x15dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23df7 expref: 46 pid: 19961 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715205776.848445:0:19961:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a73ae880/0xb608af43050086a9 lrc: 3/0,0 mode: PR/PR res: [0x15dd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23df7 expref: 46 pid: 19961 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715205776.848450:0:19961:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ae880, rc 0) 00000100:00100000:3.0:1715205776.848463:0:19961:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad5f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+46:1830:x1798520455805952:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 61us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.848467:0:19961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14704 00000100:00100000:3.0:1715205776.849286:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.849330:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455806080 00000100:00100000:2.0:1715205776.849356:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 571 00000100:00100000:2.0:1715205776.849360:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d445a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+189:11754:x1798520455806080:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.849482:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d445a40 x1798520455806080/t330712482771(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.849517:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d445a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+190:11754:x1798520455806080:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 156us (231us total) trans 330712482771 rc 0/0 00000100:00100000:2.0:1715205776.849523:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 571 00000100:00100000:0.0:1715205776.850248:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.850289:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455806208 00000100:00100000:2.0:1715205776.850307:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2108 00000100:00100000:2.0:1715205776.850310:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+190:11754:x1798520455806208:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.850317:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.850322:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009137ba80/0xb608af43050086b0 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23dfe expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.850349:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091378b40/0xb608af43050086b7 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.850355:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af43050086a2 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23df0 expref: 191 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.850359:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091378b40/0xb608af43050086b7 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.850374:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af43050086a2 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23df0 expref: 191 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.850381:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af43050086a2 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23df0 expref: 191 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.850387:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6de97c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041728:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.850417:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a9158780 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.850980:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6de97c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041728:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.850993:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091378b40/0xb608af43050086b7 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.851033:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.851066:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455806272 00010000:00010000:1.0:1715205776.851080:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af43050086a2 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23df0 expref: 192 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.851103:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4866 00000100:00100000:1.0:1715205776.851107:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad63c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+192:1831:x1798520455806272:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1715205776.851115:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.851118:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af43050086a2 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23df0 expref: 192 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.851128:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af43050086a2 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23df0 expref: 192 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.851138:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af43050086a2 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23df0 expref: 192 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.851144:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1018:0x0].0x0 (ffff880129cf6d00) 00010000:00010000:1.0:1715205776.851145:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091378b40/0xb608af43050086b7 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.851149:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091378b40/0xb608af43050086b7 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.851152:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091378b40/0xb608af43050086b7 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.851169:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.851182:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091378b40/0xb608af43050086b7 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.851186:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091378b40/0xb608af43050086b7 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.851193:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1018:0x0]: returning size 0 00000100:00100000:1.0:1715205776.851194:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad63c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+191:1831:x1798520455806272:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 86us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.851199:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4866 00010000:00010000:2.0:1715205776.851234:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009137ba80/0xb608af43050086b0 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23dfe expref: 192 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.851241:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091378b40/0xb608af43050086b7 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23dfe expref: 191 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.851244:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1018:0x0].0x0 (ffff880129cf6d00) 00010000:00010000:2.0:1715205776.851245:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.851247:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880091378b40, rc 0) 00010000:00000080:2.0:1715205776.851248:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880134ad0000 x1798520455806208/t330712482772(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.851274:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+191:11754:x1798520455806208:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 962us (1026us total) trans 330712482772 rc 0/0 00000100:00100000:2.0:1715205776.851281:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2108 00000100:00100000:0.0:1715205776.852011:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.852052:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455806336 00000100:00100000:2.0:1715205776.852076:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2109 00000100:00100000:2.0:1715205776.852080:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+191:11754:x1798520455806336:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.852088:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.852093:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091378fc0/0xb608af43050086c5 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23e05 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.852115:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009137af40/0xb608af43050086cc lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.852122:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091378b40/0xb608af43050086b7 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23dfe expref: 192 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.852127:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009137af40/0xb608af43050086cc lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.852138:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091378b40/0xb608af43050086b7 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23dfe expref: 192 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.852145:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091378b40/0xb608af43050086b7 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23dfe expref: 192 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.852151:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6de97c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041792:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.852182:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a9158780 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.852741:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6de97c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041792:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.852751:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009137af40/0xb608af43050086cc lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.852882:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.852923:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455806400 00010000:00010000:1.0:1715205776.852934:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091378b40/0xb608af43050086b7 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23dfe expref: 193 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.852956:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4867 00000100:00100000:1.0:1715205776.852960:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad4c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+193:1831:x1798520455806400:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1715205776.852966:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.852969:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091378b40/0xb608af43050086b7 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23dfe expref: 193 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.852976:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091378b40/0xb608af43050086b7 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23dfe expref: 193 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.852985:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091378b40/0xb608af43050086b7 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23dfe expref: 193 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.852994:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1018:0x0].0x0 (ffff880129cf6d00) 00010000:00010000:1.0:1715205776.852997:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009137af40/0xb608af43050086cc lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.853001:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009137af40/0xb608af43050086cc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.853006:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009137af40/0xb608af43050086cc lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.853027:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.853044:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009137af40/0xb608af43050086cc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.853049:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad4c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+192:1831:x1798520455806400:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 88us (168us total) trans 0 rc 0/0 00010000:00010000:2.0:1715205776.853050:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009137af40/0xb608af43050086cc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.853054:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4867 00000004:00200000:2.0:1715205776.853068:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1018:0x0]: returning size 0 00000004:00200000:2.0:1715205776.853071:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.853079:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009137af40/0xb608af43050086cc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.853085:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009137af40/0xb608af43050086cc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.853097:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091378fc0/0xb608af43050086c5 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e05 expref: 192 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.853105:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009137af40/0xb608af43050086cc lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e05 expref: 191 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.853110:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1018:0x0].0x0 (ffff880129cf6d00) 00010000:00010000:2.0:1715205776.853112:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.853113:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009137af40, rc 0) 00010000:00000080:2.0:1715205776.853116:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880134ad17c0 x1798520455806336/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.853145:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+191:11754:x1798520455806336:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1064us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.853150:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2109 00000100:00100000:0.0:1715205776.853906:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.853941:0:19961:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455806464 00000100:00100000:3.0:1715205776.853962:0:19961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 14705 00000100:00100000:3.0:1715205776.853966:0:19961:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad50c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+46:11754:x1798520455806464:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.853973:0:19961:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.853982:0:19961:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a73aef40/0xb608af43050086d3 lrc: 2/0,0 mode: --/PW res: [0x15dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23e0c expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.853996:0:19961:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a73ae880/0xb608af43050086a9 lrc: 2/0,0 mode: PR/PR res: [0x15dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23df7 expref: 47 pid: 19961 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715205776.854003:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205776.854004:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205776.854006:0:19961:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a73aef40/0xb608af43050086d3 lrc: 4/0,0 mode: --/PW res: [0x15dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e0c expref: 47 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.854020:0:19961:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a73ae880/0xb608af43050086a9 lrc: 3/0,0 mode: PR/PR res: [0x15dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23df7 expref: 47 pid: 19961 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1715205776.854028:0:19961:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a73ae880/0xb608af43050086a9 lrc: 4/0,0 mode: PR/PR res: [0x15dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23df7 expref: 47 pid: 19961 timeout: 3136 lvb_type: 1 00000100:00100000:3.0:1715205776.854035:0:19961:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d444740 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:19961:1798520456041856:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.854057:0:19961:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099b38c00 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.854583:0:19961:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d444740 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:19961:1798520456041856:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.854598:0:19961:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a73aef40/0xb608af43050086d3 lrc: 3/0,0 mode: --/PW res: [0x15dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e0c expref: 47 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.854606:0:19961:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73aef40, rc 0) 00000100:00100000:3.0:1715205776.854648:0:19961:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad50c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+47:11754:x1798520455806464:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 682us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.854654:0:19961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 14705 00000100:00100000:0.0:1715205776.854792:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.854810:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455806528 00010000:00010000:2.0:1715205776.854822:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a73ae880/0xb608af43050086a9 lrc: 4/0,0 mode: PR/PR res: [0x15dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23df7 expref: 47 pid: 19961 timeout: 3136 lvb_type: 1 00000100:00100000:2.0:1715205776.854843:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4868 00000100:00100000:2.0:1715205776.854846:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c63c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+47:1830:x1798520455806528:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1715205776.854853:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.854865:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a73ae880/0xb608af43050086a9 lrc: 4/0,0 mode: PR/PR res: [0x15dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23df7 expref: 47 pid: 19961 timeout: 3136 lvb_type: 1 00010000:00010000:2.0:1715205776.854873:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a73ae880/0xb608af43050086a9 lrc: 3/0,0 mode: PR/PR res: [0x15dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23df7 expref: 47 pid: 19961 timeout: 3136 lvb_type: 1 00010000:00010000:2.0:1715205776.854884:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a73ae880/0xb608af43050086a9 lrc: 0/0,0 mode: --/PR res: [0x15dd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23df7 expref: 47 pid: 19961 timeout: 3136 lvb_type: 1 00010000:00010000:2.0:1715205776.854893:0:8315:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715205776.854894:0:8315:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1715205776.854897:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a73aef40/0xb608af43050086d3 lrc: 2/0,0 mode: PW/PW res: [0x15dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e0c expref: 46 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.854903:0:8315:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a73aef40/0xb608af43050086d3 lrc: 3/0,0 mode: PW/PW res: [0x15dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e0c expref: 46 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.854919:0:8315:0:(ldlm_lockd.c:1069:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a73aef40/0xb608af43050086d3 lrc: 3/0,0 mode: PW/PW res: [0x15dd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e0c expref: 46 pid: 19961 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.854926:0:8315:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6de97c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8315:1798520456041920:192.168.204.8@tcp:105: 00000100:00100000:2.0:1715205776.854967:0:8315:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a9158c00 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.855673:0:8315:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6de97c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8315:1798520456041920:192.168.204.8@tcp:105: 00010000:00010000:2.0:1715205776.855683:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205776.855698:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c63c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+46:1830:x1798520455806528:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 852us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.855703:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4868 00000100:00100000:1.0:1715205776.856036:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.856082:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455806656 00000100:00100000:2.0:1715205776.856100:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 572 00000100:00100000:2.0:1715205776.856104:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f250050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+191:11754:x1798520455806656:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.856236:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009f250050 x1798520455806656/t330712482773(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.856264:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f250050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+192:11754:x1798520455806656:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 160us (229us total) trans 330712482773 rc 0/0 00000100:00100000:2.0:1715205776.856269:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 572 00000100:00100000:2.0:1715205776.857398:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.857463:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455806784 00000100:00100000:3.0:1715205776.857489:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2110 00000100:00100000:3.0:1715205776.857492:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6de97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+192:11754:x1798520455806784:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.857501:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.857509:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050086da lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23e13 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.857547:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050086e1 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.857555:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009137af40/0xb608af43050086cc lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e05 expref: 193 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.857560:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050086e1 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.857574:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009137af40/0xb608af43050086cc lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e05 expref: 193 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.857581:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009137af40/0xb608af43050086cc lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e05 expref: 193 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.857588:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d444740 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041984:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.857608:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099b38c00 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.858461:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d444740 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456041984:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.858475:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050086e1 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.858562:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.858594:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455806848 00010000:00010000:3.0:1715205776.858606:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009137af40/0xb608af43050086cc lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e05 expref: 194 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.858639:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4869 00000100:00100000:3.0:1715205776.858643:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a707f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+194:1830:x1798520455806848:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1715205776.858648:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.858651:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009137af40/0xb608af43050086cc lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e05 expref: 194 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.858657:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009137af40/0xb608af43050086cc lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e05 expref: 194 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.858667:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009137af40/0xb608af43050086cc lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e05 expref: 194 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.858675:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1018:0x0].0x0 (ffff880129cf6d00) 00010000:00010000:3.0:1715205776.858677:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050086e1 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.858682:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050086e1 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.858686:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050086e1 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.858701:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.858720:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050086e1 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.858720:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a707f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+193:1830:x1798520455806848:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 76us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.858736:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4869 00010000:00010000:2.0:1715205776.858739:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050086e1 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.858750:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1018:0x0]: returning size 2048 00010000:00010000:2.0:1715205776.858818:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af43050086da lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e13 expref: 194 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.858827:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050086e1 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e13 expref: 193 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.858833:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1018:0x0].0x0 (ffff880129cf6d00) 00010000:00010000:2.0:1715205776.858834:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.858836:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ad8c0, rc 0) 00010000:00000080:2.0:1715205776.858839:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6de97c0 x1798520455806784/t330712482774(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.858866:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6de97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+193:11754:x1798520455806784:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1373us (1469us total) trans 330712482774 rc 0/0 00000100:00100000:2.0:1715205776.858871:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2110 00000100:00100000:2.0:1715205776.859791:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.859827:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455806912 00000100:00100000:3.0:1715205776.859841:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2111 00000100:00100000:3.0:1715205776.859844:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6de9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+193:11754:x1798520455806912:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.859853:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.859858:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af43050086ef lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23e1a expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.859877:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050086f6 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.859882:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050086e1 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e13 expref: 194 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.859885:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050086f6 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.859897:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050086e1 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e13 expref: 194 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.859902:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050086e1 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e13 expref: 194 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.859908:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d444740 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456042048:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.859926:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099b38180 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.860459:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d444740 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456042048:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.860467:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050086f6 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.860757:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.860787:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455806976 00010000:00010000:2.0:1715205776.860798:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050086e1 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e13 expref: 195 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.860818:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4870 00000100:00100000:2.0:1715205776.860821:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d443900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+195:1831:x1798520455806976:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1715205776.860826:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.860828:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050086e1 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e13 expref: 195 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.860835:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050086e1 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e13 expref: 195 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.860847:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af43050086e1 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e13 expref: 195 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.860856:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1018:0x0].0x0 (ffff880129cf6d00) 00010000:00010000:2.0:1715205776.860858:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050086f6 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.860865:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050086f6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.860869:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050086f6 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.860889:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205776.860906:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050086f6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.860911:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d443900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+194:1831:x1798520455806976:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 89us (155us total) trans 0 rc 0/0 00010000:00010000:3.0:1715205776.860914:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050086f6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.860917:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4870 00000004:00200000:3.0:1715205776.860932:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1018:0x0]: returning size 2048 00000004:00200000:3.0:1715205776.860935:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205776.860945:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050086f6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.860951:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050086f6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.860961:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af43050086ef lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e1a expref: 194 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.860968:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050086f6 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e1a expref: 193 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.860971:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1018:0x0].0x0 (ffff880129cf6d00) 00010000:00010000:3.0:1715205776.860973:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205776.860973:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73adb00, rc 0) 00010000:00000080:3.0:1715205776.860975:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6de9c80 x1798520455806912/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.860992:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6de9c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+193:11754:x1798520455806912:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1148us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.860996:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2111 00000100:00100000:3.0:1715205776.863403:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.863454:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455807104 00000100:00100000:0.0:1715205776.863498:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2112 00000100:00100000:0.0:1715205776.863503:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d440980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+193:11754:x1798520455807104:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.863519:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.863535:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83ed00/0xb608af43050086fd lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23e21 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.863612:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305008704 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.863649:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af430500803c lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bab expref: 194 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.863657:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305008704 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.863685:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af430500803c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bab expref: 194 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.863696:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af430500803c lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bab expref: 194 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.863706:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d4c7200 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456042112:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.863769:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880129e0ea80 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.864580:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d4c7200 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456042112:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.864595:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305008704 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.864899:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.864953:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455807168 00010000:00010000:2.0:1715205776.864977:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af430500803c lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bab expref: 195 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.865008:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4871 00000100:00100000:2.0:1715205776.865013:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d440000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+195:1830:x1798520455807168:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1715205776.865023:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.865026:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af430500803c lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bab expref: 195 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.865038:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af430500803c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bab expref: 195 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.865052:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af430500803c lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23bab expref: 195 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.865061:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:2.0:1715205776.865064:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305008704 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.865070:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305008704 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.865075:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305008704 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.865090:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.865100:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305008704 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.865108:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305008704 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.865123:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1014:0x0]: returning size 19584 00000100:00100000:2.0:1715205776.865127:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d440000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+194:1830:x1798520455807168:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 114us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.865133:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4871 00010000:00010000:0.0:1715205776.865215:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83ed00/0xb608af43050086fd lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e21 expref: 195 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.865223:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305008704 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e21 expref: 194 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.865229:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:0.0:1715205776.865231:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205776.865231:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83cb40, rc 0) 00010000:00000080:0.0:1715205776.865234:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d440980 x1798520455807104/t330712482775(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.865270:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d440980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+194:11754:x1798520455807104:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1766us (1872us total) trans 330712482775 rc 0/0 00000100:00100000:0.0:1715205776.865275:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2112 00000100:00100000:3.0:1715205776.866099:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.866138:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455807232 00000100:00100000:0.0:1715205776.866171:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2113 00000100:00100000:0.0:1715205776.866175:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d445f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+194:11754:x1798520455807232:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.866191:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.866200:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305008712 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23e28 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.866241:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008719 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.866250:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305008704 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e21 expref: 195 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.866255:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008719 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.866274:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305008704 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e21 expref: 195 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.866287:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305008704 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e21 expref: 195 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.866296:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d4c7200 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456042176:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.866456:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880129e0ea80 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.867488:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d4c7200 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456042176:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.867507:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008719 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.867521:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.867590:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455807296 00010000:00010000:3.0:1715205776.867607:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305008704 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e21 expref: 196 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.867746:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4872 00000100:00100000:3.0:1715205776.867751:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ded580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+196:1831:x1798520455807296:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205776.867758:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.867762:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305008704 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e21 expref: 196 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.867770:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305008704 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e21 expref: 196 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.867783:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83cb40/0xb608af4305008704 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e21 expref: 196 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.867861:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:3.0:1715205776.867863:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008719 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.867869:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008719 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.867874:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008719 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.867889:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205776.867894:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008719 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.867906:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008719 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.867918:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ded580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+195:1831:x1798520455807296:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 167us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.867927:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4872 00000004:00200000:1.0:1715205776.867929:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1014:0x0]: returning size 19584 00000004:00200000:1.0:1715205776.867932:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205776.867942:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008719 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.867948:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008719 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.867964:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83eac0/0xb608af4305008712 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e28 expref: 195 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.867970:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008719 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e28 expref: 194 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.867974:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:1.0:1715205776.867975:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205776.867976:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83c480, rc 0) 00010000:00000080:1.0:1715205776.867978:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d445f00 x1798520455807232/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.867997:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d445f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+194:11754:x1798520455807232:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1823us (1901us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.868001:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2113 00000100:00100000:2.0:1715205776.869167:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.869214:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455807424 00000100:00100000:3.0:1715205776.869248:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 573 00000100:00100000:3.0:1715205776.869251:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6dee880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+194:11754:x1798520455807424:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:3.0:1715205776.869337:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6dee880 x1798520455807424/t330712482776(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.869361:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6dee880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+195:11754:x1798520455807424:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 110us (196us total) trans 330712482776 rc 0/0 00000100:00100000:3.0:1715205776.869365:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 573 00000100:00100000:2.0:1715205776.870309:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.870358:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455807552 00000100:00100000:0.0:1715205776.870384:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2114 00000100:00100000:0.0:1715205776.870388:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6dea140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+195:11754:x1798520455807552:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.870398:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.870408:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e1c0/0xb608af4305008720 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23e2f expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.870450:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008727 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.870460:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008719 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e28 expref: 196 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.870465:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008727 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.870483:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008719 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e28 expref: 196 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.870492:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008719 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e28 expref: 196 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.870500:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d4c7200 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456042240:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.870536:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff880129e0ea80 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.871641:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d4c7200 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456042240:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.871654:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008727 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.871695:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.871719:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455807616 00010000:00010000:0.0:1715205776.871746:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008719 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e28 expref: 197 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.871770:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4873 00000100:00100000:0.0:1715205776.871774:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d446880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+197:1830:x1798520455807616:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1715205776.871781:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.871784:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008719 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e28 expref: 197 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.871791:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008719 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e28 expref: 197 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.871806:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c480/0xb608af4305008719 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e28 expref: 197 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.871815:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:0.0:1715205776.871818:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008727 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.871823:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008727 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.871829:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008727 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.871840:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205776.871847:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008727 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.871860:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008727 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.871867:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d446880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+196:1830:x1798520455807616:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 92us (176us total) trans 0 rc 0/0 00000004:00200000:1.0:1715205776.871869:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1014:0x0]: returning size 19584 00000100:00100000:0.0:1715205776.871872:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4873 00010000:00010000:1.0:1715205776.871936:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e1c0/0xb608af4305008720 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e2f expref: 197 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.871946:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008727 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e2f expref: 196 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.871952:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:1.0:1715205776.871954:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205776.871955:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83fa80, rc 0) 00010000:00000080:1.0:1715205776.871959:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6dea140 x1798520455807552/t330712482777(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.871978:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6dea140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+196:11754:x1798520455807552:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1590us (1670us total) trans 330712482777 rc 0/0 00000100:00100000:1.0:1715205776.871984:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2114 00000100:00100000:3.0:1715205776.873220:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.873275:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455807680 00000100:00100000:1.0:1715205776.873301:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2115 00000100:00100000:1.0:1715205776.873305:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d440e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+196:11754:x1798520455807680:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.873315:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.873322:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305008735 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23e36 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.873346:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af430500873c lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.873354:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008727 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e2f expref: 197 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.873359:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af430500873c lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.873372:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008727 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e2f expref: 197 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.873379:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008727 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e2f expref: 197 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.873387:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f117200 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456042304:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.873410:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b4b93a80 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.874265:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f117200 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456042304:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.874276:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af430500873c lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.874362:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.874398:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455807744 00010000:00010000:0.0:1715205776.874426:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008727 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e2f expref: 198 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.874458:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4874 00000100:00100000:0.0:1715205776.874463:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4404c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+198:1830:x1798520455807744:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1715205776.874473:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.874478:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008727 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e2f expref: 198 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.874487:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008727 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e2f expref: 198 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.874502:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fa80/0xb608af4305008727 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e2f expref: 198 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.874518:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:0.0:1715205776.874521:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af430500873c lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.874528:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af430500873c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.874534:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af430500873c lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.874551:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205776.874559:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af430500873c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.874566:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af430500873c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205776.874585:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1014:0x0]: returning size 19584 00000004:00200000:1.0:1715205776.874588:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:0.0:1715205776.874591:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4404c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+197:1830:x1798520455807744:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 128us (230us total) trans 0 rc 0/0 00000004:00010000:1.0:1715205776.874596:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af430500873c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.874597:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4874 00010000:00010000:1.0:1715205776.874604:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af430500873c lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.874615:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305008735 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e36 expref: 197 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.874638:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af430500873c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e36 expref: 196 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.874643:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:1.0:1715205776.874644:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205776.874646:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59f3c0, rc 0) 00010000:00000080:1.0:1715205776.874649:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d440e40 x1798520455807680/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.874670:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d440e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+196:11754:x1798520455807680:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1365us (1457us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.874675:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2115 00000100:00100000:3.0:1715205776.876163:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.876194:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455807808 00000100:00100000:1.0:1715205776.876209:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2116 00000100:00100000:1.0:1715205776.876212:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d444740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+196:11754:x1798520455807808:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.876218:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.876224:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305008743 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23e3d expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.876243:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af430500874a lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.876250:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af430500874a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.876255:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af430500874a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.876260:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305008751 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.876263:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305008751 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.876266:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305008751 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.876305:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af430500874a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.876309:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af430500874a lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.876314:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af430500874a lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.876319:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59d200 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.876321:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af430500874a lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.876326:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af430500874a lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.876333:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205776.876335:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.876337:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af430500874a lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.876341:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af430500874a lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.876347:0:14860:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305008751 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.876352:0:14860:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305008751 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.876356:0:14860:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305008751 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.876359:0:14860:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59dd40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:1.0:1715205776.876361:0:14860:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305008751 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.876365:0:14860:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305008751 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.876370:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x78ea50f (ffff880135bf2300) 00010000:00010000:1.0:1715205776.876372:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.876373:0:14860:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305008751 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.876381:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af4305008751 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.876404:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305008743 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e3d expref: 197 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.876410:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305008743 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e3d expref: 197 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.876415:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59ed00, rc 0) 00010000:00000080:1.0:1715205776.876418:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d444740 x1798520455807808/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.876453:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d444740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+196:11754:x1798520455807808:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 240us (292us total) trans 0 rc 301/301 00000100:00100000:1.0:1715205776.876459:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2116 00000100:00100000:1.0:1715205776.877694:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.877709:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455807872 00000100:00100000:1.0:1715205776.877735:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2117 00000100:00100000:1.0:1715205776.877739:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f117200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+196:11754:x1798520455807872:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.877746:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.877752:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305008758 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23e44 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.877765:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305008758 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e44 expref: 197 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.877776:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305008758 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e44 expref: 197 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.877780:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:1.0:1715205776.877782:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1715205776.877783:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59eac0, rc 0) 00010000:00000080:1.0:1715205776.877786:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f117200 x1798520455807872/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 328/344 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.877807:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f117200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+197:11754:x1798520455807872:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 68us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.877812:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2117 00000100:00100000:3.0:1715205776.878870:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.878887:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455807936 00000100:00100000:3.0:1715205776.878919:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 574 00000100:00100000:3.0:1715205776.878923:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d445a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+197:11754:x1798520455807936:12345-192.168.204.8@tcp:37:dbench.0 00010000:00000080:3.0:1715205776.880639:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d445a40 x1798520455807936/t0(0) o37->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 448/440 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00010000:00010000:0.0:1715205776.880664:0:8314:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1715205776.880665:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d445a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+197:11754:x1798520455807936:12345-192.168.204.8@tcp:37:dbench.0 Request processed in 1741us (1796us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.880670:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 574 00000100:00100000:1.0:1715205776.882371:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.882412:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455808000 00000100:00100000:3.0:1715205776.882433:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2118 00000100:00100000:3.0:1715205776.882437:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f113440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+197:11754:x1798520455808000:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.882447:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.882457:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af430500875f lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23e4b expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.882493:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305008766 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.882503:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305008766 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.882510:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305008766 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.882519:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af430500876d lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.882523:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af430500876d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.882527:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af430500876d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.882564:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305008766 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.882569:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305008766 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.882572:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305008766 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.882577:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ae640 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205776.882579:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305008766 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.882583:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305008766 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.882590:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205776.882591:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205776.882593:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305008766 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.882597:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae640/0xb608af4305008766 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.882603:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af430500876d lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.882607:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af430500876d lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.882610:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af430500876d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.882614:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73acb40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205776.882615:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af430500876d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.882635:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af430500876d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.882640:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0xec6f74b7 (ffff88012cbdc900) 00010000:00010000:3.0:1715205776.882641:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205776.882643:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af430500876d lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.882646:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acb40/0xb608af430500876d lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.882674:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af430500875f lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e4b expref: 198 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.882679:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afcc0/0xb608af430500875f lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e4b expref: 198 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.882684:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73afcc0, rc 0) 00010000:00000080:3.0:1715205776.882687:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f113440 x1798520455808000/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.882710:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f113440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+197:11754:x1798520455808000:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 273us (342us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205776.882715:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2118 00000100:00100000:3.0:1715205776.884315:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.884360:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455808128 00000100:00100000:2.0:1715205776.884386:0:14868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 575 00000100:00100000:2.0:1715205776.884390:0:14868:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910e97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+197:11754:x1798520455808128:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.884486:0:14868:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910e97c0 x1798520455808128/t330712482778(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.884520:0:14868:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910e97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+198:11754:x1798520455808128:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 129us (206us total) trans 330712482778 rc 0/0 00000100:00100000:2.0:1715205776.884525:0:14868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 575 00000100:00100000:0.0:1715205776.885566:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.885640:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455808256 00000100:00100000:3.0:1715205776.885710:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2119 00000100:00100000:3.0:1715205776.885714:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+198:11754:x1798520455808256:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.885733:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.885742:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af4305008774 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23e52 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.885787:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500877b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.885802:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af430500873c lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e36 expref: 199 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.885807:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500877b lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.885829:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af430500873c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e36 expref: 199 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.885838:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af430500873c lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e36 expref: 199 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.885847:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800910e84c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456042368:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.885879:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099b38840 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.886547:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800910e84c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456042368:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.886560:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500877b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.886699:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.886760:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455808320 00010000:00010000:2.0:1715205776.886772:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af430500873c lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e36 expref: 200 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.886803:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4875 00000100:00100000:2.0:1715205776.886806:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c5580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+200:1831:x1798520455808320:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1715205776.886814:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.886818:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af430500873c lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e36 expref: 200 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.886825:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af430500873c lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e36 expref: 200 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.886836:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af430500873c lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e36 expref: 200 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.886845:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:2.0:1715205776.886848:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500877b lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.886853:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500877b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.886858:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500877b lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.886884:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205776.886912:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c5580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+199:1831:x1798520455808320:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 104us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.886918:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4875 00010000:00010000:3.0:1715205776.886974:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500877b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.886980:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500877b lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205776.886990:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1014:0x0]: returning size 19584 00010000:00010000:3.0:1715205776.887067:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad8c0/0xb608af4305008774 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e52 expref: 200 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.887082:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500877b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e52 expref: 199 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.887087:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:3.0:1715205776.887089:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1715205776.887090:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73af180, rc 0) 00010000:00000080:3.0:1715205776.887093:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c7200 x1798520455808256/t330712482779(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.887130:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c7200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+199:11754:x1798520455808256:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1415us (1565us total) trans 330712482779 rc 0/0 00000100:00100000:3.0:1715205776.887135:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2119 00000100:00100000:0.0:1715205776.887986:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.888038:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455808384 00000100:00100000:3.0:1715205776.888071:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2120 00000100:00100000:3.0:1715205776.888075:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+199:11754:x1798520455808384:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.888085:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.888092:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305008789 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23e59 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.888119:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305008790 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.888127:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500877b lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e52 expref: 200 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.888133:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305008790 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.888151:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500877b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e52 expref: 200 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.888158:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500877b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e52 expref: 200 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.888165:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800910e84c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456042432:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.888201:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099b38840 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.888953:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800910e84c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456042432:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.888965:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305008790 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.889032:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.889083:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455808448 00010000:00010000:2.0:1715205776.889096:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500877b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e52 expref: 201 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.889121:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4876 00000100:00100000:2.0:1715205776.889125:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a707e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+201:1831:x1798520455808448:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1715205776.889132:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.889135:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500877b lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e52 expref: 201 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.889141:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500877b lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e52 expref: 201 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.889151:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500877b lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e52 expref: 201 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.889159:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:2.0:1715205776.889161:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305008790 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.889166:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305008790 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.889174:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305008790 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.889195:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205776.889223:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a707e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+200:1831:x1798520455808448:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 97us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.889228:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4876 00010000:00010000:3.0:1715205776.889319:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305008790 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.889326:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305008790 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205776.889347:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1014:0x0]: returning size 19584 00000004:00200000:3.0:1715205776.889349:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205776.889358:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305008790 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.889365:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305008790 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.889377:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae1c0/0xb608af4305008789 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e59 expref: 200 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.889390:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305008790 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e59 expref: 199 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.889395:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:3.0:1715205776.889397:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205776.889398:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ae880, rc 0) 00010000:00000080:3.0:1715205776.889401:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c4280 x1798520455808384/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.889439:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+199:11754:x1798520455808384:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1363us (1458us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.889444:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2120 00000100:00100000:0.0:1715205776.890553:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.890595:0:14868:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455808576 00000100:00100000:1.0:1715205776.890638:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 576 00000100:00100000:1.0:1715205776.890641:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c50c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+199:11754:x1798520455808576:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.890735:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c50c0 x1798520455808576/t330712482780(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.890764:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c50c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+200:11754:x1798520455808576:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 122us (212us total) trans 330712482780 rc 0/0 00000100:00100000:1.0:1715205776.890769:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 576 00000100:00100000:1.0:1715205776.891615:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.891654:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455808704 00000100:00100000:3.0:1715205776.891680:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2121 00000100:00100000:3.0:1715205776.891684:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1150c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+200:11754:x1798520455808704:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.891693:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.891702:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305008797 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23e60 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.891756:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af430500879e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.891765:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305008790 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e59 expref: 201 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.891770:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af430500879e lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.891788:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305008790 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e59 expref: 201 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.891794:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305008790 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e59 expref: 201 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.891799:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800910e84c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456042496:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.891827:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099b38840 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.892429:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800910e84c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456042496:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.892442:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af430500879e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.892781:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.892841:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455808768 00010000:00010000:2.0:1715205776.892853:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305008790 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e59 expref: 202 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.892877:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4877 00000100:00100000:2.0:1715205776.892881:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f115580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+202:1831:x1798520455808768:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1715205776.892887:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.892890:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305008790 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e59 expref: 202 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.892897:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305008790 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e59 expref: 202 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.892908:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305008790 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e59 expref: 202 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.892917:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:2.0:1715205776.892919:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af430500879e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.892929:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af430500879e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.892934:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af430500879e lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.892955:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205776.892973:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af430500879e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.892979:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f115580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+201:1831:x1798520455808768:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 97us (198us total) trans 0 rc 0/0 00010000:00010000:3.0:1715205776.892979:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af430500879e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.892984:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4877 00000004:00200000:3.0:1715205776.892989:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1014:0x0]: returning size 19584 00010000:00010000:3.0:1715205776.893058:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305008797 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e60 expref: 202 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.893070:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af430500879e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e60 expref: 201 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.893075:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:3.0:1715205776.893077:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1715205776.893079:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73af840, rc 0) 00010000:00000080:3.0:1715205776.893081:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f1150c0 x1798520455808704/t330712482781(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.893110:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1150c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+201:11754:x1798520455808704:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1425us (1496us total) trans 330712482781 rc 0/0 00000100:00100000:3.0:1715205776.893116:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2121 00000100:00100000:1.0:1715205776.894154:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.894199:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455808832 00000100:00100000:3.0:1715205776.894223:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2122 00000100:00100000:3.0:1715205776.894227:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f115f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+201:11754:x1798520455808832:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.894237:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.894244:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af43050087ac lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23e67 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.894268:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050087b3 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.894275:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af430500879e lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e60 expref: 202 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.894280:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050087b3 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.894293:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af430500879e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e60 expref: 202 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.894300:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af430500879e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e60 expref: 202 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.894307:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800910e84c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456042560:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.894337:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099b38840 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.895073:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800910e84c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456042560:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.895082:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050087b3 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.895203:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.895248:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455808896 00010000:00010000:2.0:1715205776.895260:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af430500879e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e60 expref: 203 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.895287:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4878 00000100:00100000:2.0:1715205776.895291:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f110980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+203:1830:x1798520455808896:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1715205776.895297:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.895300:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af430500879e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e60 expref: 203 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.895307:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af430500879e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e60 expref: 203 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.895317:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af430500879e lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e60 expref: 203 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.895325:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:2.0:1715205776.895328:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050087b3 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.895333:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050087b3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.895338:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050087b3 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.895357:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205776.895373:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050087b3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.895380:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050087b3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.895382:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f110980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+202:1830:x1798520455808896:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 90us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.895387:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4878 00000004:00200000:3.0:1715205776.895402:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1014:0x0]: returning size 19584 00000004:00200000:3.0:1715205776.895405:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205776.895414:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050087b3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.895421:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050087b3 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.895434:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af43050087ac lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e67 expref: 202 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.895446:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050087b3 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e67 expref: 201 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.895451:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1014:0x0].0x0 (ffff880135bf2f00) 00010000:00010000:3.0:1715205776.895453:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205776.895455:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ad200, rc 0) 00010000:00000080:3.0:1715205776.895458:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f115f00 x1798520455808832/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.895484:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f115f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+201:11754:x1798520455808832:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1256us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.895489:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2122 00000100:00100000:1.0:1715205776.896766:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.896812:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455808960 00000100:00100000:3.0:1715205776.896838:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2123 00000100:00100000:3.0:1715205776.896842:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f113dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+201:11754:x1798520455808960:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.896854:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.896862:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050087ba lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23e6e expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.896885:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050087c1 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.896893:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050087c1 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.896899:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050087c1 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.896908:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af43050087c8 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.896913:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af43050087c8 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.896918:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af43050087c8 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.896969:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050087c1 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.896975:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050087c1 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.896979:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050087c1 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.896984:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73acd80 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205776.896986:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050087c1 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.896990:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050087c1 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.896996:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205776.896998:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205776.897000:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050087c1 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.897004:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af43050087c1 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.897012:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af43050087c8 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.897017:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af43050087c8 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.897025:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af43050087c8 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.897028:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73add40 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205776.897029:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af43050087c8 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.897033:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af43050087c8 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.897038:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x78ea50f (ffff88012cbdc300) 00010000:00010000:3.0:1715205776.897039:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205776.897040:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af43050087c8 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.897043:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af43050087c8 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.897069:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050087ba lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e6e expref: 202 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.897074:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af43050087ba lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e6e expref: 202 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.897079:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ae400, rc 0) 00010000:00000080:3.0:1715205776.897082:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f113dc0 x1798520455808960/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.897115:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f113dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+201:11754:x1798520455808960:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 272us (351us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205776.897121:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2123 00000100:00100000:0.0:1715205776.898139:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.898188:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455809024 00000100:00100000:3.0:1715205776.898217:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2124 00000100:00100000:3.0:1715205776.898222:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c0980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+201:11754:x1798520455809024:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.898229:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.898235:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af43050087cf lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23e75 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.898254:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af43050087d6 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.898260:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af43050087d6 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.898266:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af43050087d6 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.898274:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050087dd lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.898279:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050087dd lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.898284:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050087dd lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.898308:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af43050087d6 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.898318:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af43050087d6 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.898322:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af43050087d6 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.898326:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ad440 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205776.898328:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af43050087d6 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.898332:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af43050087d6 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.898338:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205776.898340:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205776.898341:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af43050087d6 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.898345:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af43050087d6 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.898352:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050087dd lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.898356:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050087dd lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.898360:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050087dd lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.898367:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73acfc0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205776.898368:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050087dd lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.898372:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050087dd lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.898378:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0xec6f74b7 (ffff88012cbdc000) 00010000:00010000:3.0:1715205776.898379:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205776.898380:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050087dd lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.898384:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af43050087dd lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.898409:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af43050087cf lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e75 expref: 202 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.898414:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af43050087cf lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e75 expref: 202 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.898420:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73aed00, rc 0) 00010000:00000080:3.0:1715205776.898423:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c0980 x1798520455809024/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.898449:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c0980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+201:11754:x1798520455809024:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 228us (316us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205776.898453:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2124 00000100:00100000:0.0:1715205776.900246:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.900325:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455809152 00000100:00100000:1.0:1715205776.900384:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 577 00000100:00100000:1.0:1715205776.900389:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+201:11754:x1798520455809152:12345-192.168.204.8@tcp:35:dbench.0 00000001:00080000:1.0:1715205776.900561:0:14188:0:(tgt_lastrcvd.c:2017:tgt_txn_stop_cb()) More than one transaction 330712482782 00010000:00000080:1.0:1715205776.900588:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c1c80 x1798520455809152/t330712482782(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.900646:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+202:11754:x1798520455809152:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 256us (401us total) trans 330712482782 rc 0/0 00000100:00100000:1.0:1715205776.900652:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 577 00000100:00100000:1.0:1715205776.901528:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.901578:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455809280 00000100:00100000:3.0:1715205776.901828:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2125 00000100:00100000:3.0:1715205776.901832:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1117c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+202:11754:x1798520455809280:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.901842:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.901851:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af43050087e4 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23e7c expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.901899:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050087eb lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.902175:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050086f6 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e1a expref: 203 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.902182:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050087eb lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.902208:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050086f6 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e1a expref: 203 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.902217:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050086f6 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e1a expref: 203 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.902227:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800910e84c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456042624:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.902265:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099b38840 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.903370:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.903427:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455809344 00010000:00010000:2.0:1715205776.903445:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050086f6 lrc: 5/0,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e1a expref: 204 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.903450:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800910e84c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456042624:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.903465:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050087eb lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.903477:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4879 00000100:00100000:2.0:1715205776.903481:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c76c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+204:1830:x1798520455809344:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1715205776.903490:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.903494:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050086f6 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e1a expref: 204 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.903501:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050086f6 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e1a expref: 204 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.903513:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af43050086f6 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e1a expref: 204 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.903528:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1018:0x0].0x0 (ffff880129cf6d00) 00010000:00010000:2.0:1715205776.903530:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050087eb lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.903540:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050087eb lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.903546:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050087eb lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.903567:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205776.903581:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050087eb lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.903587:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050087eb lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.903592:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c76c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+203:1830:x1798520455809344:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 110us (224us total) trans 0 rc 0/0 00000004:00200000:3.0:1715205776.903596:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1018:0x0]: returning size 4096 00000100:00100000:2.0:1715205776.903598:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4879 00010000:00010000:3.0:1715205776.903687:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af43050087e4 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e7c expref: 204 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.903697:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050087eb lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e7c expref: 203 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.903702:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1018:0x0].0x0 (ffff880129cf6d00) 00010000:00010000:3.0:1715205776.903704:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1715205776.903705:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73af600, rc 0) 00010000:00000080:3.0:1715205776.903708:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f1117c0 x1798520455809280/t330712482783(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.903755:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1117c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+203:11754:x1798520455809280:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1922us (2228us total) trans 330712482783 rc 0/0 00000100:00100000:3.0:1715205776.903761:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2125 00000100:00100000:0.0:1715205776.904773:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.904825:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455809408 00000100:00100000:3.0:1715205776.904853:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2126 00000100:00100000:3.0:1715205776.904857:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+203:11754:x1798520455809408:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.904868:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.904876:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af43050087f9 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23e83 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.904902:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305008800 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.904910:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050087eb lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e7c expref: 204 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.904915:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305008800 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.904930:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050087eb lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e7c expref: 204 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.904937:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050087eb lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e7c expref: 204 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.904944:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800910e84c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456042688:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.904976:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099b38840 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.905685:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800910e84c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456042688:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.905698:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305008800 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.905719:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.905780:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455809472 00010000:00010000:2.0:1715205776.905803:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050087eb lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e7c expref: 205 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.905834:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4880 00000100:00100000:2.0:1715205776.905842:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c3900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+205:1831:x1798520455809472:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1715205776.905851:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.905855:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050087eb lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e7c expref: 205 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.905864:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050087eb lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e7c expref: 205 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.905883:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af43050087eb lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e7c expref: 205 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.905893:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1018:0x0].0x0 (ffff880129cf6d00) 00010000:00010000:2.0:1715205776.905896:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305008800 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.905903:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305008800 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.905909:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305008800 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.905931:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205776.905957:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305008800 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.905960:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c3900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+204:1831:x1798520455809472:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 118us (242us total) trans 0 rc 0/0 00010000:00010000:3.0:1715205776.905964:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305008800 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.905965:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4880 00000004:00200000:3.0:1715205776.905987:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0x1018:0x0]: returning size 4096 00000004:00200000:3.0:1715205776.905989:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205776.905999:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305008800 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.906258:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305008800 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.906274:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af43050087f9 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e83 expref: 204 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.906290:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305008800 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e83 expref: 203 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.906295:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1018:0x0].0x0 (ffff880129cf6d00) 00010000:00010000:3.0:1715205776.906297:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205776.906298:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73aeac0, rc 0) 00010000:00000080:3.0:1715205776.906301:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c1300 x1798520455809408/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.906340:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c1300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+203:11754:x1798520455809408:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1482us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.906345:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2126 00000100:00100000:0.0:1715205776.908191:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.908231:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455809600 00000100:00100000:1.0:1715205776.908257:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 578 00000100:00100000:1.0:1715205776.908259:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f253050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+203:11754:x1798520455809600:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.908338:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009f253050 x1798520455809600/t330712482784(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.908372:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f253050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+204:11754:x1798520455809600:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 111us (183us total) trans 330712482784 rc 0/0 00000100:00100000:1.0:1715205776.908377:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 578 00000100:00100000:1.0:1715205776.909309:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.909359:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455809728 00000100:00100000:2.0:1715205776.909395:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 579 00000100:00100000:2.0:1715205776.909400:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f112ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+204:11754:x1798520455809728:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.909595:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f112ac0 x1798520455809728/t330712482785(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.909653:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f112ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+205:11754:x1798520455809728:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 252us (345us total) trans 330712482785 rc 0/0 00000100:00100000:2.0:1715205776.909659:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 579 00000100:00100000:0.0:1715205776.910262:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.910295:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455809856 00000100:00100000:2.0:1715205776.910318:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 580 00000100:00100000:2.0:1715205776.910322:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+205:11754:x1798520455809856:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.910384:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c2ac0 x1798520455809856/t330712482786(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.910412:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:11754:x1798520455809856:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 90us (152us total) trans 330712482786 rc 0/0 00000100:00100000:2.0:1715205776.910418:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 580 00000100:00100000:0.0:1715205776.911047:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.911095:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455809984 00000100:00100000:2.0:1715205776.911129:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 581 00000100:00100000:2.0:1715205776.911133:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+206:11754:x1798520455809984:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.911280:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c2f80 x1798520455809984/t330712482787(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.911316:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+207:11754:x1798520455809984:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 183us (270us total) trans 330712482787 rc 0/0 00000100:00100000:2.0:1715205776.911321:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 581 00000100:00100000:1.0:1715205776.912113:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.912153:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455810112 00000100:00100000:2.0:1715205776.912177:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 582 00000100:00100000:2.0:1715205776.912181:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1176c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+207:11754:x1798520455810112:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.912252:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f1176c0 x1798520455810112/t330712482788(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.912272:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1176c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+208:11754:x1798520455810112:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 91us (162us total) trans 330712482788 rc 0/0 00000100:00100000:2.0:1715205776.912277:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 582 00000100:00100000:0.0:1715205776.913004:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.913059:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455810240 00000100:00100000:2.0:1715205776.913075:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 583 00000100:00100000:2.0:1715205776.913079:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+208:11754:x1798520455810240:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.913169:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c5a40 x1798520455810240/t330712482789(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.913203:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+209:11754:x1798520455810240:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 123us (200us total) trans 330712482789 rc 0/0 00000100:00100000:2.0:1715205776.913209:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 583 00000100:00100000:0.0:1715205776.913897:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.913947:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455810368 00000100:00100000:2.0:1715205776.913972:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 584 00000100:00100000:2.0:1715205776.913975:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f250850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+209:11754:x1798520455810368:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.914063:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009f250850 x1798520455810368/t330712482790(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.914097:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f250850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+210:11754:x1798520455810368:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 121us (201us total) trans 330712482790 rc 0/0 00000100:00100000:2.0:1715205776.914102:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 584 00000100:00100000:1.0:1715205776.914694:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.914747:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455810496 00000100:00100000:2.0:1715205776.914774:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 585 00000100:00100000:2.0:1715205776.914778:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f111300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+210:11754:x1798520455810496:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.914823:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f111300 x1798520455810496/t330712482791(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.914840:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f111300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+211:11754:x1798520455810496:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 63us (149us total) trans 330712482791 rc 0/0 00000100:00100000:2.0:1715205776.914844:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 585 00000100:00100000:0.0:1715205776.915458:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.915511:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455810624 00000100:00100000:2.0:1715205776.915535:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 586 00000100:00100000:2.0:1715205776.915539:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+211:11754:x1798520455810624:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.915595:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c2140 x1798520455810624/t330712482792(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.915654:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+212:11754:x1798520455810624:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 115us (197us total) trans 330712482792 rc 0/0 00000100:00100000:2.0:1715205776.915660:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 586 00000100:00100000:0.0:1715205776.916452:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.916487:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455810752 00000100:00100000:2.0:1715205776.916503:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 587 00000100:00100000:2.0:1715205776.916506:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c4740 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+212:11754:x1798520455810752:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.916566:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c4740 x1798520455810752/t330712482793(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.916595:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c4740 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+213:11754:x1798520455810752:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 88us (144us total) trans 330712482793 rc 0/0 00000100:00100000:2.0:1715205776.916600:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 587 00000100:00100000:1.0:1715205776.917315:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.917354:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455810880 00000100:00100000:2.0:1715205776.917377:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 588 00000100:00100000:2.0:1715205776.917384:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f115a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+213:11754:x1798520455810880:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.917431:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f115a40 x1798520455810880/t330712482794(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.917447:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f115a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+214:11754:x1798520455810880:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 63us (133us total) trans 330712482794 rc 0/0 00000100:00100000:2.0:1715205776.917450:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 588 00000100:00100000:0.0:1715205776.918143:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.918187:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455811008 00000100:00100000:2.0:1715205776.918213:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 589 00000100:00100000:2.0:1715205776.918216:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c0e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+214:11754:x1798520455811008:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.918271:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c0e40 x1798520455811008/t330712482795(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.918306:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c0e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+215:11754:x1798520455811008:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 89us (164us total) trans 330712482795 rc 0/0 00000100:00100000:2.0:1715205776.918313:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 589 00000100:00100000:0.0:1715205776.918942:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.919007:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455811136 00000100:00100000:2.0:1715205776.919026:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 590 00000100:00100000:2.0:1715205776.919030:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f251050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+215:11754:x1798520455811136:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:2.0:1715205776.919083:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009f251050 x1798520455811136/t330712482796(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.919114:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f251050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+216:11754:x1798520455811136:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 83us (173us total) trans 330712482796 rc 0/0 00000100:00100000:2.0:1715205776.919118:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 590 00000100:00100000:1.0:1715205776.919659:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.919681:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455811264 00000100:00100000:1.0:1715205776.919693:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 591 00000100:00100000:1.0:1715205776.919695:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1163c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+216:11754:x1798520455811264:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.919771:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f1163c0 x1798520455811264/t330712482797(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.919805:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1163c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+217:11754:x1798520455811264:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 107us (147us total) trans 330712482797 rc 0/0 00000100:00100000:1.0:1715205776.919810:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 591 00000100:00100000:0.0:1715205776.920342:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.920374:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455811392 00000100:00100000:1.0:1715205776.920385:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 592 00000100:00100000:1.0:1715205776.920387:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+217:11754:x1798520455811392:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.920462:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c5f00 x1798520455811392/t330712482798(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.920486:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+218:11754:x1798520455811392:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 98us (145us total) trans 330712482798 rc 0/0 00000100:00100000:1.0:1715205776.920489:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 592 00000100:00100000:0.0:1715205776.921100:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.921134:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455811520 00000100:00100000:1.0:1715205776.921151:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 593 00000100:00100000:1.0:1715205776.921153:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+218:11754:x1798520455811520:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.921214:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c17c0 x1798520455811520/t330712482799(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.921238:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+219:11754:x1798520455811520:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 84us (138us total) trans 330712482799 rc 0/0 00000100:00100000:1.0:1715205776.921241:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 593 00000100:00100000:2.0:1715205776.921886:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.921927:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455811648 00000100:00100000:1.0:1715205776.921948:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 594 00000100:00100000:1.0:1715205776.921951:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ded580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+219:11754:x1798520455811648:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.922010:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6ded580 x1798520455811648/t330712482800(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.922042:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ded580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:11754:x1798520455811648:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 90us (157us total) trans 330712482800 rc 0/0 00000100:00100000:1.0:1715205776.922048:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 594 00000100:00100000:0.0:1715205776.922564:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.922595:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455811776 00000100:00100000:1.0:1715205776.922607:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 595 00000100:00100000:1.0:1715205776.922609:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+220:11754:x1798520455811776:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.922674:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c6880 x1798520455811776/t330712482801(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.922703:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+221:11754:x1798520455811776:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 92us (140us total) trans 330712482801 rc 0/0 00000100:00100000:1.0:1715205776.922708:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 595 00000100:00100000:0.0:1715205776.923310:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.923340:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455811904 00000100:00100000:1.0:1715205776.923355:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 596 00000100:00100000:1.0:1715205776.923357:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f253850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+221:11754:x1798520455811904:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.923398:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009f253850 x1798520455811904/t330712482802(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.923420:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f253850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+222:11754:x1798520455811904:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 62us (112us total) trans 330712482802 rc 0/0 00000100:00100000:1.0:1715205776.923423:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 596 00000100:00100000:2.0:1715205776.924098:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.924128:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455812032 00000100:00100000:1.0:1715205776.924145:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 597 00000100:00100000:1.0:1715205776.924147:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6deb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+222:11754:x1798520455812032:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.924187:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6deb440 x1798520455812032/t330712482803(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.924203:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6deb440 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+223:11754:x1798520455812032:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 56us (107us total) trans 330712482803 rc 0/0 00000100:00100000:1.0:1715205776.924207:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 597 00000100:00100000:0.0:1715205776.924913:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.924955:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455812160 00000100:00100000:1.0:1715205776.924972:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 598 00000100:00100000:1.0:1715205776.924976:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+223:11754:x1798520455812160:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.925057:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c5f00 x1798520455812160/t330712482804(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.925090:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c5f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+224:11754:x1798520455812160:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 114us (180us total) trans 330712482804 rc 0/0 00000100:00100000:1.0:1715205776.925096:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 598 00000100:00100000:0.0:1715205776.925651:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.925706:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455812288 00000100:00100000:1.0:1715205776.925738:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 599 00000100:00100000:1.0:1715205776.925742:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+224:11754:x1798520455812288:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.925827:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c17c0 x1798520455812288/t330712482805(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.925861:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c17c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+225:11754:x1798520455812288:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 118us (210us total) trans 330712482805 rc 0/0 00000100:00100000:1.0:1715205776.925867:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 599 00000100:00100000:2.0:1715205776.926386:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.926439:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455812416 00000100:00100000:1.0:1715205776.926458:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 600 00000100:00100000:1.0:1715205776.926463:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6deaf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+225:11754:x1798520455812416:12345-192.168.204.8@tcp:35:dbench.0 00010000:00000080:1.0:1715205776.926538:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6deaf80 x1798520455812416/t330712482806(0) o35->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 392/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.926557:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6deaf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+226:11754:x1798520455812416:12345-192.168.204.8@tcp:35:dbench.0 Request processed in 95us (173us total) trans 330712482806 rc 0/0 00000100:00100000:1.0:1715205776.926561:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 600 00000100:00100000:0.0:1715205776.927303:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.927358:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455812544 00000100:00100000:3.0:1715205776.927385:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2127 00000100:00100000:3.0:1715205776.927388:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+226:11754:x1798520455812544:12345-192.168.204.8@tcp:36:dbench.0 00010000:00010000:3.0:1715205776.927419:0:14185:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1715205776.927440:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aeac0/0xb608af4305008800 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e83 expref: 226 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.927456:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af430500868d lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23de9 expref: 225 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.927464:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1018:0x0].0x0 (ffff880129cf6d00) 00010000:00010000:3.0:1715205776.927476:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af4305008758 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e44 expref: 224 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.927483:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205776.927485:0:14185:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205776.927509:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305008807 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.927520:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305008807 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.927529:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305008807 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.927541:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af430500880e lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.927546:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af430500880e lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.927552:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af430500880e lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.927676:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305008815 lrc: 3/0,1 mode: --/EX res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.927683:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305008815 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.927688:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305008815 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1715205776.927983:0:14185:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x136:0x0].69, 64 off12608 00010000:00010000:3.0:1715205776.928019:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af430500881c lrc: 3/0,1 mode: --/PW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.928023:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af430500881c lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.928028:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af430500881c lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.928032:0:14185:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af430500881c lrc: 4/0,1 mode: PW/PW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.928035:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af430500881c lrc: 4/0,1 mode: PW/PW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.928038:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af430500881c lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.928058:0:14185:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1715205776.928069:0:14185:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88012d4c6880 reply state ffff880091e1a000 transno 330712482807 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305008815 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.928086:0:6665:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715205776.928090:0:6665:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af430500881c lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.928096:0:6665:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ac900 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:2.0:1715205776.928098:0:6665:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af430500881c lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.928099:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305008807 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.928103:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305008807 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.928106:0:6665:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af430500881c lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.928106:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305008807 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.928108:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73af3c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205776.928110:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305008807 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.928112:0:6665:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1018:0x0].0x0 (ffff88012cbdc300) 00010000:00010000:3.0:1715205776.928112:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305008807 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.928114:0:6665:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1715205776.928115:0:6665:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af430500881c lrc: 1/0,0 mode: --/PW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.928116:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205776.928117:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.928118:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac900/0xb608af430500881c lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446612135023065872 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.928118:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305008807 lrc: 2/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.928120:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af3c0/0xb608af4305008807 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1715205776.928123:0:14185:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88012d4c6880 reply state ffff880091e1a000 transno 330712482807 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af430500880e lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.928131:0:6665:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715205776.928131:0:6665:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715205776.928132:0:6665:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000080:3.0:1715205776.928133:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c6880 x1798520455812544/t330712482807(0) o36->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 504/456 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.928166:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c6880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+225:11754:x1798520455812544:12345-192.168.204.8@tcp:36:dbench.0 Request processed in 778us (865us total) trans 330712482807 rc 0/0 00000100:00100000:3.0:1715205776.928171:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2127 00010000:00010000:2.0:1715205776.928606:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af430500880e lrc: 3/0,1 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.928611:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af430500880e lrc: 2/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.928613:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af430500880e lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.928638:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ac6c0 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.928639:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af430500880e lrc: 3/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.928642:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af430500880e lrc: 4/0,0 mode: PW/PW res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.928647:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x51a48d55 (ffff88012cbdc000) 00010000:00010000:2.0:1715205776.928649:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1715205776.928650:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af430500880e lrc: 2/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.928653:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac6c0/0xb608af430500880e lrc: 0/0,0 mode: --/PW res: [0x20001b1b3:0xedf:0x0].0x51a48d55 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.928661:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305008815 lrc: 3/0,1 mode: EX/EX res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.928663:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305008815 lrc: 2/0,0 mode: EX/EX res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.928665:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305008815 lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.928668:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73af600 already unused, calling callback (ffffffffa1341360) 00010000:00010000:2.0:1715205776.928669:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305008815 lrc: 3/0,0 mode: EX/EX res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.928672:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305008815 lrc: 4/0,0 mode: EX/EX res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.928674:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0x1018:0x0].0x0 (ffff88012cbdc300) 00010000:00010000:2.0:1715205776.928675:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1715205776.928676:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305008815 lrc: 2/0,0 mode: --/EX res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.928681:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af600/0xb608af4305008815 lrc: 0/0,0 mode: --/EX res: [0x20001b1b3:0x1018:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.929003:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.929020:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455812608 00000100:00100000:3.0:1715205776.929036:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2128 00000100:00100000:3.0:1715205776.929040:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1163c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+224:11754:x1798520455812608:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.929049:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.929056:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305008823 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23e8a expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.929084:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af430500882a lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.929091:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af430500882a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.929097:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af430500882a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.929106:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305008831 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.929111:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305008831 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.929115:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305008831 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.929145:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af430500882a lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.929150:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af430500882a lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.929154:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af430500882a lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.929159:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73adb00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205776.929160:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af430500882a lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.929165:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af430500882a lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.929171:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205776.929173:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205776.929174:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af430500882a lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.929178:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73adb00/0xb608af430500882a lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.929186:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305008831 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.929190:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305008831 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.929199:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305008831 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.929203:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73aed00 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205776.929204:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305008831 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.929208:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305008831 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.929214:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x54f6b75a (ffff88012cbdce00) 00010000:00010000:3.0:1715205776.929216:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205776.929217:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305008831 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.929221:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73aed00/0xb608af4305008831 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.929248:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305008823 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e8a expref: 225 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.929254:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73afa80/0xb608af4305008823 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e8a expref: 225 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.929260:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73afa80, rc 0) 00010000:00000080:3.0:1715205776.929263:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012f1163c0 x1798520455812608/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.929296:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1163c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+224:11754:x1798520455812608:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 255us (295us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205776.929302:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2128 00000100:00100000:0.0:1715205776.929998:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.930036:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455812672 00000100:00100000:3.0:1715205776.930051:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2129 00000100:00100000:3.0:1715205776.930055:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+224:11754:x1798520455812672:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.930061:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.930066:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305008838 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23e91 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.930078:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305008838 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e91 expref: 225 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.930086:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305008838 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e91 expref: 225 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.930092:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205776.930093:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205776.930095:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73acfc0, rc 0) 00010000:00000080:3.0:1715205776.930097:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c2140 x1798520455812672/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 328/344 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.930133:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+225:11754:x1798520455812672:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 77us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.930138:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2129 00000100:00100000:0.0:1715205776.931228:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.931279:0:14188:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455812736 00000100:00100000:1.0:1715205776.931301:0:14188:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 601 00000100:00100000:1.0:1715205776.931305:0:14188:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c4740 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+225:11754:x1798520455812736:12345-192.168.204.8@tcp:37:dbench.0 00010000:00000080:1.0:1715205776.933060:0:14188:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c4740 x1798520455812736/t0(0) o37->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 448/440 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.933095:0:14188:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c4740 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+225:11754:x1798520455812736:12345-192.168.204.8@tcp:37:dbench.0 Request processed in 1789us (1867us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.933102:0:14188:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 601 00000100:00100000:0.0:1715205776.934585:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.934708:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455812864 00000100:00100000:3.0:1715205776.934763:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2130 00000100:00100000:3.0:1715205776.934768:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c0e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+225:11754:x1798520455812864:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.934781:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.934796:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af430500883f lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23e98 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.934858:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305008846 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.934869:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af430500853d lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d79 expref: 226 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.934874:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305008846 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.934898:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af430500853d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d79 expref: 226 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.934907:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af430500853d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d79 expref: 226 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.934916:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800910e84c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456042752:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.934967:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099b38b40 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.935967:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800910e84c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456042752:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.935980:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305008846 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.936102:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.936158:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455812928 00010000:00010000:2.0:1715205776.936171:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af430500853d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d79 expref: 227 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.936185:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4881 00000100:00100000:2.0:1715205776.936187:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+227:1830:x1798520455812928:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1715205776.936192:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.936194:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af430500853d lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d79 expref: 227 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.936199:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af430500853d lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d79 expref: 227 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.936208:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83dd40/0xb608af430500853d lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d79 expref: 227 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.936217:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef2:0x0].0x0 (ffff8801336c2f00) 00010000:00010000:2.0:1715205776.936219:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305008846 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.936223:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305008846 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.936226:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305008846 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.936245:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205776.936265:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305008846 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.936271:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305008846 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.936274:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+226:1830:x1798520455812928:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 85us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.936279:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4881 00000004:00200000:3.0:1715205776.936285:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xef2:0x0]: returning size 260096 00010000:00010000:3.0:1715205776.936369:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad440/0xb608af430500883f lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e98 expref: 227 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.936381:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305008846 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e98 expref: 226 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.936386:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef2:0x0].0x0 (ffff8801336c2f00) 00010000:00010000:3.0:1715205776.936388:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1715205776.936390:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ae400, rc 0) 00010000:00000080:3.0:1715205776.936393:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c0e40 x1798520455812864/t330712482808(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.936427:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c0e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+226:11754:x1798520455812864:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1659us (1844us total) trans 330712482808 rc 0/0 00000100:00100000:3.0:1715205776.936433:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2130 00000100:00100000:0.0:1715205776.937363:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.937397:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455812992 00000100:00100000:3.0:1715205776.937411:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2131 00000100:00100000:3.0:1715205776.937413:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+226:11754:x1798520455812992:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.937420:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.937425:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305008854 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23e9f expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.937444:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500885b lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.937449:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305008846 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e98 expref: 227 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.937453:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500885b lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.937462:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305008846 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e98 expref: 227 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.937467:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305008846 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e98 expref: 227 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.937471:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800910e84c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456042816:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.937495:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099b38b40 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.938082:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800910e84c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456042816:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.938092:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500885b lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.938193:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.938230:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455813056 00010000:00010000:2.0:1715205776.938241:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305008846 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e98 expref: 228 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.938256:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4882 00000100:00100000:2.0:1715205776.938258:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+228:1830:x1798520455813056:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1715205776.938262:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.938264:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305008846 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e98 expref: 228 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.938268:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305008846 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e98 expref: 228 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.938274:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae400/0xb608af4305008846 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e98 expref: 228 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.938280:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef2:0x0].0x0 (ffff8801336c2f00) 00010000:00010000:2.0:1715205776.938281:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500885b lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.938285:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500885b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.938290:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500885b lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.938303:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205776.938315:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+227:1830:x1798520455813056:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 57us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.938319:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4882 00010000:00010000:3.0:1715205776.938324:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500885b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.938329:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500885b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1715205776.938347:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xef2:0x0]: returning size 260096 00000004:00200000:3.0:1715205776.938349:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1715205776.938359:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500885b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.938365:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500885b lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.938378:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73add40/0xb608af4305008854 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e9f expref: 227 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.938387:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500885b lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e9f expref: 226 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.938392:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xef2:0x0].0x0 (ffff8801336c2f00) 00010000:00010000:3.0:1715205776.938394:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1715205776.938395:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73acd80, rc 0) 00010000:00000080:3.0:1715205776.938398:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c2f80 x1798520455812992/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.938420:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+226:11754:x1798520455812992:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1005us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.938425:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2131 00000100:00100000:0.0:1715205776.939583:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.939642:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455813120 00000100:00100000:3.0:1715205776.939659:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2132 00000100:00100000:3.0:1715205776.939662:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c50c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+226:11754:x1798520455813120:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.939669:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.939676:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305008862 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23ea6 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.939696:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305008869 lrc: 3/1,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.939703:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305008869 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.939712:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305008869 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.939720:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305008870 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.939740:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305008870 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.939744:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305008870 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.939790:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305008869 lrc: 3/1,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.939794:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305008869 lrc: 2/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.939798:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305008869 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.939802:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ac000 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205776.939804:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305008869 lrc: 3/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.939808:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305008869 lrc: 4/0,0 mode: CR/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.939813:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x0 (ffff8800b410f400) 00010000:00010000:3.0:1715205776.939815:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205776.939817:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305008869 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.939820:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac000/0xb608af4305008869 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.939830:0:14185:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305008870 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.939834:0:14185:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305008870 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.939838:0:14185:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305008870 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.939841:0:14185:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73af840 already unused, calling callback (ffffffffa1341360) 00010000:00010000:3.0:1715205776.939841:0:14185:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305008870 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.939844:0:14185:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305008870 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.939848:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xedf:0x0].0x54f6b75a (ffff88012cbdc900) 00010000:00010000:3.0:1715205776.939850:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1715205776.939851:0:14185:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305008870 lrc: 2/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.939854:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af840/0xb608af4305008870 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.939879:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305008862 lrc: 1/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ea6 expref: 227 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.939884:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac240/0xb608af4305008862 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ea6 expref: 227 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.939890:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73ac240, rc 0) 00010000:00000080:3.0:1715205776.939893:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c50c0 x1798520455813120/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 584/640 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 301/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.939920:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c50c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+226:11754:x1798520455813120:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 257us (338us total) trans 0 rc 301/301 00000100:00100000:3.0:1715205776.939924:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2132 00000100:00100000:0.0:1715205776.940936:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.940972:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455813248 00000100:00100000:3.0:1715205776.940990:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2133 00000100:00100000:3.0:1715205776.940993:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+226:11754:x1798520455813248:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:3.0:1715205776.940998:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1715205776.941003:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305008877 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23ead expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.941038:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500887e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.941046:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af43050082ff lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ca0 expref: 227 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.941051:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500887e lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.941068:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af43050082ff lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ca0 expref: 227 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.941076:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af43050082ff lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ca0 expref: 227 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.941084:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800910e84c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456042880:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.941121:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099b38b40 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.941699:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800910e84c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456042880:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.941710:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500887e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.941794:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.941839:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455813312 00010000:00010000:2.0:1715205776.941852:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af43050082ff lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ca0 expref: 228 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.941869:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4883 00000100:00100000:2.0:1715205776.941872:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a70a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+228:1830:x1798520455813312:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1715205776.941878:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.941881:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af43050082ff lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ca0 expref: 228 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.941886:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af43050082ff lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ca0 expref: 228 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.941895:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadaac0/0xb608af43050082ff lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ca0 expref: 228 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.941903:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:2.0:1715205776.941905:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500887e lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.941914:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500887e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.941918:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500887e lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.941935:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205776.941950:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500887e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.941952:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a70a0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+227:1830:x1798520455813312:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 78us (158us total) trans 0 rc 0/0 00010000:00010000:3.0:1715205776.941956:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500887e lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.941957:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4883 00000004:00200000:3.0:1715205776.941965:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee4:0x0]: returning size 260096 00010000:00010000:3.0:1715205776.942034:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ae880/0xb608af4305008877 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ead expref: 228 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.942042:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500887e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ead expref: 227 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.942052:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:3.0:1715205776.942053:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1715205776.942055:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a73af180, rc 0) 00010000:00000080:3.0:1715205776.942057:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c1c80 x1798520455813248/t330712482809(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:3.0:1715205776.942084:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c1c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+227:11754:x1798520455813248:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1090us (1150us total) trans 330712482809 rc 0/0 00000100:00100000:3.0:1715205776.942089:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2133 00000100:00100000:0.0:1715205776.942812:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.942851:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455813376 00000100:00100000:2.0:1715205776.942876:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2134 00000100:00100000:2.0:1715205776.942879:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+227:11754:x1798520455813376:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.942888:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.942894:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913798c0/0xb608af430500888c lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23eb4 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.942916:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009137a640/0xb608af4305008893 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.942924:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500887e lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ead expref: 228 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.942929:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009137a640/0xb608af4305008893 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.942944:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500887e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ead expref: 228 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.942955:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500887e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ead expref: 228 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.942962:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6dec280 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456042944:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.942991:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff880129e0eb40 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.943544:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6dec280 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456042944:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.943554:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009137a640/0xb608af4305008893 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.943690:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.943733:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455813440 00010000:00010000:2.0:1715205776.943744:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500887e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ead expref: 229 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.943758:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4884 00000100:00100000:2.0:1715205776.943762:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c63c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+229:1831:x1798520455813440:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1715205776.943767:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.943769:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500887e lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ead expref: 229 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.943775:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500887e lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ead expref: 229 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.943784:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73af180/0xb608af430500887e lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ead expref: 229 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.943793:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:2.0:1715205776.943795:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009137a640/0xb608af4305008893 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.943799:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009137a640/0xb608af4305008893 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.943804:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009137a640/0xb608af4305008893 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.943813:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.943821:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009137a640/0xb608af4305008893 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.943827:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009137a640/0xb608af4305008893 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.943837:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c63c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+228:1831:x1798520455813440:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 75us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.943842:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4884 00000004:00200000:0.0:1715205776.943843:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee4:0x0]: returning size 260096 00000004:00200000:0.0:1715205776.943845:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205776.943853:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009137a640/0xb608af4305008893 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.943859:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009137a640/0xb608af4305008893 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.943870:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913798c0/0xb608af430500888c lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23eb4 expref: 228 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.943880:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009137a640/0xb608af4305008893 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23eb4 expref: 227 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.943885:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee4:0x0].0x0 (ffff88012bf50200) 00010000:00010000:0.0:1715205776.943887:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205776.943889:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009137a640, rc 0) 00010000:00000080:0.0:1715205776.943891:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c5580 x1798520455813376/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.943937:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c5580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+227:11754:x1798520455813376:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1057us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.943946:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2134 00000100:00100000:0.0:1715205776.945079:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.945119:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455813568 00000100:00100000:1.0:1715205776.945138:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2135 00000100:00100000:1.0:1715205776.945142:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+227:11754:x1798520455813568:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.945149:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.945156:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af430500889a lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23ebb expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.945193:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af43050088a1 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.945200:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305008322 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cae expref: 228 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.945205:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af43050088a1 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.945219:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305008322 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cae expref: 228 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.945226:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305008322 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cae expref: 228 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.945243:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f115580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456043008:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.945282:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b4b930c0 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.945992:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f115580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456043008:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.946004:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af43050088a1 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.946070:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.946104:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455813632 00010000:00010000:2.0:1715205776.946113:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305008322 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cae expref: 229 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.946124:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4885 00000100:00100000:2.0:1715205776.946127:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c76c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+229:1830:x1798520455813632:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1715205776.946130:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.946132:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305008322 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cae expref: 229 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.946138:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305008322 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cae expref: 229 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.946148:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af4305008322 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cae expref: 229 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.946156:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee5:0x0].0x0 (ffff8800a5d65a00) 00010000:00010000:2.0:1715205776.946158:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af43050088a1 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.946166:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af43050088a1 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.946172:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af43050088a1 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.946188:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205776.946205:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af43050088a1 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.946205:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c76c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+228:1830:x1798520455813632:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 77us (136us total) trans 0 rc 0/0 00010000:00010000:1.0:1715205776.946210:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af43050088a1 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.946210:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4885 00000004:00200000:1.0:1715205776.946219:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee5:0x0]: returning size 260096 00010000:00010000:1.0:1715205776.946280:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af430500889a lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ebb expref: 229 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.946288:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af43050088a1 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ebb expref: 228 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.946297:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee5:0x0].0x0 (ffff8800a5d65a00) 00010000:00010000:1.0:1715205776.946298:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205776.946299:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59ed00, rc 0) 00010000:00000080:1.0:1715205776.946302:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c6d40 x1798520455813568/t330712482810(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.946330:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c6d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+228:11754:x1798520455813568:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1188us (1251us total) trans 330712482810 rc 0/0 00000100:00100000:1.0:1715205776.946334:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2135 00000100:00100000:0.0:1715205776.947018:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.947050:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455813696 00000100:00100000:1.0:1715205776.947067:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2136 00000100:00100000:1.0:1715205776.947070:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+228:11754:x1798520455813696:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.947078:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.947084:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af43050088af lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23ec2 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.947107:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af43050088b6 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.947114:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af43050088a1 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ebb expref: 229 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.947118:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af43050088b6 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.947131:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af43050088a1 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ebb expref: 229 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.947142:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af43050088a1 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ebb expref: 229 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.947149:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f115580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456043072:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.947174:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b4b930c0 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.947774:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f115580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456043072:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.947781:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af43050088b6 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.947801:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.947853:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455813760 00010000:00010000:3.0:1715205776.947876:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af43050088a1 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ebb expref: 230 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.947910:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4886 00000100:00100000:3.0:1715205776.947914:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6decc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+230:1830:x1798520455813760:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1715205776.947922:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.947926:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af43050088a1 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ebb expref: 230 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.947933:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af43050088a1 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ebb expref: 230 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.947946:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af43050088a1 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ebb expref: 230 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.947955:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee5:0x0].0x0 (ffff8800a5d65a00) 00010000:00010000:3.0:1715205776.947957:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af43050088b6 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.947964:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af43050088b6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.947973:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af43050088b6 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.948034:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.948045:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af43050088b6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.948052:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af43050088b6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.948069:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6decc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+229:1830:x1798520455813760:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 155us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.948075:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4886 00000004:00200000:0.0:1715205776.948082:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee5:0x0]: returning size 260096 00000004:00200000:0.0:1715205776.948085:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1715205776.948097:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af43050088b6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.948105:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af43050088b6 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.948123:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af43050088af lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ec2 expref: 229 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.948134:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af43050088b6 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ec2 expref: 228 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.948140:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee5:0x0].0x0 (ffff8800a5d65a00) 00010000:00010000:0.0:1715205776.948142:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1715205776.948143:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59d200, rc 0) 00010000:00000080:0.0:1715205776.948148:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c3900 x1798520455813696/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.948170:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+228:11754:x1798520455813696:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1099us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.948176:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2136 00000100:00100000:2.0:1715205776.949837:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.949905:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455813888 00000100:00100000:0.0:1715205776.949935:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2137 00000100:00100000:0.0:1715205776.949939:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6deaac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+228:11754:x1798520455813888:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.949951:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.949962:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af43050088bd lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23ec9 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.950020:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af43050088c4 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.950028:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af4305008345 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cbc expref: 229 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.950032:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af43050088c4 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.950051:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af4305008345 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cbc expref: 229 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.950057:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af4305008345 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cbc expref: 229 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.950068:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d4c2ac0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456043136:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.950114:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a6dc6540 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.950940:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d4c2ac0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456043136:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.950954:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af43050088c4 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.951204:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.951263:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455813952 00010000:00010000:3.0:1715205776.951284:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af4305008345 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cbc expref: 230 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.951310:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4887 00000100:00100000:3.0:1715205776.951314:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ded0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+230:1831:x1798520455813952:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1715205776.951321:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.951324:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af4305008345 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cbc expref: 230 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.951331:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af4305008345 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cbc expref: 230 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.951345:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d200/0xb608af4305008345 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cbc expref: 230 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.951356:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee6:0x0].0x0 (ffff88008f367800) 00010000:00010000:3.0:1715205776.951358:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af43050088c4 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.951366:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af43050088c4 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.951370:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af43050088c4 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.951386:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1715205776.951403:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af43050088c4 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.951408:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af43050088c4 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.951412:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ded0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+229:1831:x1798520455813952:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 98us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.951416:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4887 00000004:00200000:2.0:1715205776.951422:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee6:0x0]: returning size 260096 00010000:00010000:2.0:1715205776.951519:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83df80/0xb608af43050088bd lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ec9 expref: 230 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.951529:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af43050088c4 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ec9 expref: 229 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.951533:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee6:0x0].0x0 (ffff88008f367800) 00010000:00010000:2.0:1715205776.951534:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.951535:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83f180, rc 0) 00010000:00000080:2.0:1715205776.951538:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6deaac0 x1798520455813888/t330712482811(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.951558:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6deaac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+229:11754:x1798520455813888:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1619us (1724us total) trans 330712482811 rc 0/0 00000100:00100000:2.0:1715205776.951564:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2137 00000100:00100000:2.0:1715205776.952669:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.952689:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455814016 00000100:00100000:2.0:1715205776.952707:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2138 00000100:00100000:2.0:1715205776.952710:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6def6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+229:11754:x1798520455814016:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.952738:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.952746:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091378480/0xb608af43050088d2 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23ed0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.952778:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091379440/0xb608af43050088d9 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.952786:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af43050088c4 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ec9 expref: 230 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.952791:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091379440/0xb608af43050088d9 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.952811:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af43050088c4 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ec9 expref: 230 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.952820:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af43050088c4 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ec9 expref: 230 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.952828:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6debdc0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456043200:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.952865:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff880129e0ea80 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.953955:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6debdc0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456043200:192.168.204.8@tcp:104: 00010000:00010000:2.0:1715205776.953968:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091379440/0xb608af43050088d9 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.954030:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.954074:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455814080 00010000:00010000:3.0:1715205776.954095:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af43050088c4 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ec9 expref: 231 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.954129:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4888 00000100:00100000:3.0:1715205776.954133:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6debdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+231:1831:x1798520455814080:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205776.954142:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.954146:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af43050088c4 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ec9 expref: 231 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.954155:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af43050088c4 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ec9 expref: 231 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.954169:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f180/0xb608af43050088c4 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ec9 expref: 231 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.954179:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee6:0x0].0x0 (ffff88008f367800) 00010000:00010000:3.0:1715205776.954183:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091379440/0xb608af43050088d9 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.954190:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091379440/0xb608af43050088d9 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.954195:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091379440/0xb608af43050088d9 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.954223:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205776.954260:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6debdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+230:1831:x1798520455814080:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 127us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.954266:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4888 00010000:00010000:2.0:1715205776.954300:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091379440/0xb608af43050088d9 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.954308:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091379440/0xb608af43050088d9 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.954332:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee6:0x0]: returning size 260096 00000004:00200000:2.0:1715205776.954335:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1715205776.954346:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091379440/0xb608af43050088d9 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.954354:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091379440/0xb608af43050088d9 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.954369:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091378480/0xb608af43050088d2 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ed0 expref: 230 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.954379:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091379440/0xb608af43050088d9 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ed0 expref: 229 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.954385:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee6:0x0].0x0 (ffff88008f367800) 00010000:00010000:2.0:1715205776.954387:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1715205776.954388:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880091379440, rc 0) 00010000:00000080:2.0:1715205776.954391:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6def6c0 x1798520455814016/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.954427:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6def6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+229:11754:x1798520455814016:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1716us (1759us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.954433:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2138 00000100:00100000:2.0:1715205776.955953:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.955972:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455814208 00000100:00100000:2.0:1715205776.956003:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2139 00000100:00100000:2.0:1715205776.956007:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6def200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+229:11754:x1798520455814208:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:2.0:1715205776.956017:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1715205776.956025:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800913798c0/0xb608af43050088e0 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23ed7 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.956070:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009137bcc0/0xb608af43050088e7 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.956079:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305008368 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cca expref: 230 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.956084:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009137bcc0/0xb608af43050088e7 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.956101:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305008368 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cca expref: 230 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.956108:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305008368 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cca expref: 230 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.956116:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6dec740 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456043264:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.956140:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff880129e0ea80 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.957119:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6dec740 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456043264:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.957132:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009137bcc0/0xb608af43050088e7 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.957750:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.957810:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455814272 00010000:00010000:3.0:1715205776.957826:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305008368 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cca expref: 231 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.957859:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4889 00000100:00100000:3.0:1715205776.957862:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6dec740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+231:1830:x1798520455814272:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1715205776.957869:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.957873:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305008368 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cca expref: 231 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.957880:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305008368 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cca expref: 231 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.957891:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83db00/0xb608af4305008368 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cca expref: 231 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.957901:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee7:0x0].0x0 (ffff88008f367600) 00010000:00010000:3.0:1715205776.957903:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009137bcc0/0xb608af43050088e7 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.957909:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009137bcc0/0xb608af43050088e7 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.957914:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009137bcc0/0xb608af43050088e7 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.957936:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205776.957967:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6dec740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+230:1830:x1798520455814272:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 104us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.957972:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4889 00010000:00010000:2.0:1715205776.957976:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009137bcc0/0xb608af43050088e7 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.957982:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009137bcc0/0xb608af43050088e7 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1715205776.958016:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee7:0x0]: returning size 260096 00010000:00010000:2.0:1715205776.958113:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913798c0/0xb608af43050088e0 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ed7 expref: 231 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.958124:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009137bcc0/0xb608af43050088e7 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ed7 expref: 230 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.958128:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee7:0x0].0x0 (ffff88008f367600) 00010000:00010000:2.0:1715205776.958129:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1715205776.958130:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88009137bcc0, rc 0) 00010000:00000080:2.0:1715205776.958133:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6def200 x1798520455814208/t330712482812(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:2.0:1715205776.958165:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6def200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+230:11754:x1798520455814208:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 2158us (2214us total) trans 330712482812 rc 0/0 00000100:00100000:2.0:1715205776.958173:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2139 00000100:00100000:2.0:1715205776.959665:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.959718:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455814336 00000100:00100000:0.0:1715205776.959766:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2140 00000100:00100000:0.0:1715205776.959771:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6dec280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+230:11754:x1798520455814336:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:0.0:1715205776.959790:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1715205776.959803:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af43050088f5 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23ede expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.959847:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af43050088fc lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.959859:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009137bcc0/0xb608af43050088e7 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ed7 expref: 231 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.959865:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af43050088fc lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.959889:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009137bcc0/0xb608af43050088e7 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ed7 expref: 231 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.959898:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009137bcc0/0xb608af43050088e7 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ed7 expref: 231 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.959908:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d4c5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456043328:192.168.204.8@tcp:104: 00000100:00100000:0.0:1715205776.959960:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a6dc6480 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.960770:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d4c5a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456043328:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.960783:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af43050088fc lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.961041:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:0.0:1715205776.961076:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455814400 00010000:00010000:0.0:1715205776.961091:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009137bcc0/0xb608af43050088e7 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ed7 expref: 232 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.961118:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4890 00000100:00100000:0.0:1715205776.961122:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a707e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+232:1830:x1798520455814400:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1715205776.961129:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.961133:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009137bcc0/0xb608af43050088e7 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ed7 expref: 232 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.961141:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009137bcc0/0xb608af43050088e7 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ed7 expref: 232 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.961154:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009137bcc0/0xb608af43050088e7 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ed7 expref: 232 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.961165:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee7:0x0].0x0 (ffff88008f367600) 00010000:00010000:0.0:1715205776.961167:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af43050088fc lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.961172:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af43050088fc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.961177:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af43050088fc lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.961197:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205776.961216:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af43050088fc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.961223:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a707e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+231:1830:x1798520455814400:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 101us (183us total) trans 0 rc 0/0 00010000:00010000:1.0:1715205776.961226:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af43050088fc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.961232:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4890 00000004:00200000:1.0:1715205776.961295:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee7:0x0]: returning size 260096 00000004:00200000:1.0:1715205776.961299:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205776.961311:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af43050088fc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.961320:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af43050088fc lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.961337:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83fcc0/0xb608af43050088f5 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ede expref: 231 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.961348:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af43050088fc lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ede expref: 230 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.961354:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee7:0x0].0x0 (ffff88008f367600) 00010000:00010000:1.0:1715205776.961356:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205776.961357:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012c83f3c0, rc 0) 00010000:00000080:1.0:1715205776.961361:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6dec280 x1798520455814336/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.961403:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6dec280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+230:11754:x1798520455814336:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1631us (1739us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.961409:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2140 00000100:00100000:0.0:1715205776.962459:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.962502:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455814528 00000100:00100000:1.0:1715205776.962523:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2141 00000100:00100000:1.0:1715205776.962526:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+230:11754:x1798520455814528:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.962535:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.962542:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305008903 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23ee5 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.962594:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af430500890a lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.962603:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500838b lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cd8 expref: 231 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.962609:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af430500890a lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.962649:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500838b lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cd8 expref: 231 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.962663:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500838b lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cd8 expref: 231 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.962672:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f110980 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456043392:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.962713:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b4b93e40 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.963508:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f110980 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456043392:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.963525:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af430500890a lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.963655:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.963708:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455814592 00010000:00010000:1.0:1715205776.963736:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500838b lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cd8 expref: 232 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.963756:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4891 00000100:00100000:1.0:1715205776.963760:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c76c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+232:1830:x1798520455814592:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1715205776.963768:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.963771:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500838b lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cd8 expref: 232 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.963778:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500838b lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cd8 expref: 232 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.963791:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada1c0/0xb608af430500838b lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cd8 expref: 232 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.963801:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee8:0x0].0x0 (ffff88009399e700) 00010000:00010000:1.0:1715205776.963804:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af430500890a lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.963810:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af430500890a lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.963815:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af430500890a lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.963826:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205776.963847:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c76c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+231:1830:x1798520455814592:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 87us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.963852:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4891 00010000:00010000:0.0:1715205776.963967:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af430500890a lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.963974:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af430500890a lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1715205776.963989:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee8:0x0]: returning size 260096 00010000:00010000:0.0:1715205776.964105:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ed00/0xb608af4305008903 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ee5 expref: 232 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.964117:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af430500890a lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ee5 expref: 231 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.964122:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee8:0x0].0x0 (ffff88009399e700) 00010000:00010000:0.0:1715205776.964125:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1715205776.964126:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59e640, rc 0) 00010000:00000080:0.0:1715205776.964130:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c63c0 x1798520455814528/t330712482813(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:0.0:1715205776.964166:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c63c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+231:11754:x1798520455814528:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1638us (1708us total) trans 330712482813 rc 0/0 00000100:00100000:0.0:1715205776.964172:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2141 00000100:00100000:0.0:1715205776.965183:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.965256:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455814656 00000100:00100000:1.0:1715205776.965288:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2142 00000100:00100000:1.0:1715205776.965292:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+231:11754:x1798520455814656:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.965303:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.965310:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305008918 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23eec expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.965337:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af430500891f lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.965345:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af430500890a lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ee5 expref: 232 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.965349:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af430500891f lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.965364:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af430500890a lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ee5 expref: 232 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.965371:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af430500890a lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ee5 expref: 232 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.965377:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f110980 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456043456:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.965416:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b4b93e40 going to sleep for 6 seconds 00000100:00100000:2.0:1715205776.966340:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.966350:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f110980 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456043456:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.966362:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af430500891f lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.966373:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455814720 00010000:00010000:0.0:1715205776.966387:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af430500890a lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ee5 expref: 233 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.966402:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4892 00000100:00100000:0.0:1715205776.966410:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ded580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+233:1831:x1798520455814720:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1715205776.966417:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1715205776.966420:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af430500890a lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ee5 expref: 233 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.966427:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af430500890a lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ee5 expref: 233 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.966437:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e640/0xb608af430500890a lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ee5 expref: 233 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.966445:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee8:0x0].0x0 (ffff88009399e700) 00010000:00010000:0.0:1715205776.966447:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af430500891f lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.966452:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af430500891f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.966456:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af430500891f lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.966473:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1715205776.966507:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ded580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+232:1831:x1798520455814720:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 100us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.966512:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4892 00010000:00010000:1.0:1715205776.966568:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af430500891f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.966574:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af430500891f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205776.966597:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee8:0x0]: returning size 260096 00000004:00200000:1.0:1715205776.966603:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205776.966613:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af430500891f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.966637:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af430500891f lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.966649:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59db00/0xb608af4305008918 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23eec expref: 232 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.966655:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af430500891f lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23eec expref: 231 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.966659:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee8:0x0].0x0 (ffff88009399e700) 00010000:00010000:1.0:1715205776.966660:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205776.966661:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59dd40, rc 0) 00010000:00000080:1.0:1715205776.966664:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012d4c5a40 x1798520455814656/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.966694:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+231:11754:x1798520455814656:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1402us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.966700:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2142 00000100:00100000:2.0:1715205776.967842:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.967891:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455814848 00000100:00100000:1.0:1715205776.967922:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2143 00000100:00100000:1.0:1715205776.967926:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6dee880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+231:11754:x1798520455814848:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.967935:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.967944:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305008926 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23ef3 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.967996:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500892d lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.968005:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af43050083ae lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ce6 expref: 232 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.968010:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500892d lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.968028:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af43050083ae lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ce6 expref: 232 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.968040:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af43050083ae lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ce6 expref: 232 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.968048:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f110980 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456043520:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.968084:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b4b93e40 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.968959:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.968974:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f110980 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456043520:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.968984:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500892d lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.968998:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455814912 00010000:00010000:2.0:1715205776.969013:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af43050083ae lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ce6 expref: 233 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.969029:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4893 00000100:00100000:2.0:1715205776.969032:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c2ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+233:1831:x1798520455814912:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1715205776.969039:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.969042:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af43050083ae lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ce6 expref: 233 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.969048:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af43050083ae lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ce6 expref: 233 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.969059:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadad00/0xb608af43050083ae lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ce6 expref: 233 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.969067:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee9:0x0].0x0 (ffff88009399e100) 00010000:00010000:2.0:1715205776.969070:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500892d lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.969075:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500892d lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.969083:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500892d lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.969104:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205776.969128:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500892d lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.969136:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500892d lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.969136:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c2ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+232:1831:x1798520455814912:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 103us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.969141:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4893 00000004:00200000:1.0:1715205776.969146:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee9:0x0]: returning size 260096 00010000:00010000:1.0:1715205776.969239:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f3c0/0xb608af4305008926 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ef3 expref: 233 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.969249:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500892d lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ef3 expref: 232 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.969255:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee9:0x0].0x0 (ffff88009399e100) 00010000:00010000:1.0:1715205776.969256:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205776.969258:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59eac0, rc 0) 00010000:00000080:1.0:1715205776.969261:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a6dee880 x1798520455814848/t330712482814(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.969296:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6dee880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+232:11754:x1798520455814848:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1369us (1454us total) trans 330712482814 rc 0/0 00000100:00100000:1.0:1715205776.969302:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2143 00000100:00100000:0.0:1715205776.970108:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.970145:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455814976 00000100:00100000:1.0:1715205776.970159:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2144 00000100:00100000:1.0:1715205776.970161:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f621300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+232:11754:x1798520455814976:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.970168:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.970173:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af430500893b lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23efa expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.970193:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008942 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.970198:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500892d lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ef3 expref: 233 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.970201:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008942 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.970211:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500892d lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ef3 expref: 233 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.970216:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500892d lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ef3 expref: 233 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.970220:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f110980 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456043584:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.970246:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b4b93e40 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.971026:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f110980 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456043584:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.971035:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008942 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.971259:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.971310:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455815040 00010000:00010000:2.0:1715205776.971323:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500892d lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ef3 expref: 234 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.971349:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4894 00000100:00100000:2.0:1715205776.971353:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6250c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+234:1830:x1798520455815040:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1715205776.971359:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.971362:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500892d lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ef3 expref: 234 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.971369:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500892d lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ef3 expref: 234 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.971379:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59eac0/0xb608af430500892d lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ef3 expref: 234 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.971387:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee9:0x0].0x0 (ffff88009399e100) 00010000:00010000:2.0:1715205776.971389:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008942 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.971398:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008942 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.971402:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008942 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.971419:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205776.971434:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008942 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.971441:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008942 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.971444:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6250c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+233:1830:x1798520455815040:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 91us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.971450:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4894 00000004:00200000:1.0:1715205776.971455:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xee9:0x0]: returning size 260096 00000004:00200000:1.0:1715205776.971457:0:14185:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205776.971464:0:14185:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008942 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.971469:0:14185:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008942 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.971482:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f600/0xb608af430500893b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23efa expref: 233 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.971490:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008942 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23efa expref: 232 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.971495:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xee9:0x0].0x0 (ffff88009399e100) 00010000:00010000:1.0:1715205776.971497:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205776.971498:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59fcc0, rc 0) 00010000:00000080:1.0:1715205776.971501:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009f621300 x1798520455814976/t0(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 576/696 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.971537:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f621300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+232:11754:x1798520455814976:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1374us (1432us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.971543:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2144 00000100:00100000:0.0:1715205776.972713:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:1.0:1715205776.972811:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455815168 00000100:00100000:1.0:1715205776.972829:0:14185:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2145 00000100:00100000:1.0:1715205776.972833:0:14185:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f622f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+232:11754:x1798520455815168:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.972841:0:14185:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.972848:0:14185:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305008949 lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23f01 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.972894:0:14185:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305008950 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.972903:0:14185:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af43050083d1 lrc: 2/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cf4 expref: 233 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.972908:0:14185:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305008950 lrc: 4/0,1 mode: --/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.972922:0:14185:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af43050083d1 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cf4 expref: 233 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.972930:0:14185:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af43050083d1 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cf4 expref: 233 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.972937:0:14185:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f110980 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456043648:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.972968:0:14185:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b4b93e40 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.973710:0:14185:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f110980 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14185:1798520456043648:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.973733:0:14185:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305008950 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1715205776.973953:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.973986:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455815232 00010000:00010000:2.0:1715205776.973999:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af43050083d1 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cf4 expref: 234 pid: 14860 timeout: 3136 lvb_type: 0 00000100:00100000:2.0:1715205776.974026:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4895 00000100:00100000:2.0:1715205776.974029:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6263c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+234:1830:x1798520455815232:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1715205776.974036:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.974039:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af43050083d1 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cf4 expref: 234 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.974046:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af43050083d1 lrc: 3/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cf4 expref: 234 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.974055:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb180/0xb608af43050083d1 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23cf4 expref: 234 pid: 14860 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.974063:0:8315:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeea:0x0].0x0 (ffff88012e817a00) 00010000:00010000:2.0:1715205776.974066:0:8315:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305008950 lrc: 3/0,1 mode: --/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.974071:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305008950 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.974076:0:8315:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305008950 lrc: 4/0,1 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.974094:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205776.974116:0:14185:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305008950 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.974121:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6263c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+233:1830:x1798520455815232:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 91us (168us total) trans 0 rc 0/0 00010000:00010000:1.0:1715205776.974123:0:14185:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305008950 lrc: 3/0,1 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.974126:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4895 00000004:00200000:1.0:1715205776.974132:0:14185:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeea:0x0]: returning size 260096 00010000:00010000:1.0:1715205776.974204:0:14185:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d680/0xb608af4305008949 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23f01 expref: 234 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.974211:0:14185:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305008950 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23f01 expref: 233 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.974214:0:14185:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeea:0x0].0x0 (ffff88012e817a00) 00010000:00010000:1.0:1715205776.974215:0:14185:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1715205776.974216:0:14185:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59e1c0, rc 0) 00010000:00000080:1.0:1715205776.974219:0:14185:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009f622f80 x1798520455815168/t330712482815(0) o101->41bc1ae4-4825-48bc-b22e-9cbe8affc36b@192.168.204.8@tcp:557/0 lens 648/656 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'dbench.0' 00000100:00100000:1.0:1715205776.974243:0:14185:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f622f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+233:11754:x1798520455815168:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 1410us (1533us total) trans 330712482815 rc 0/0 00000100:00100000:1.0:1715205776.974247:0:14185:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2145 00000020:01000004:3.0:1715205776.974861:0:17642:0:(obd_mount_server.c:1591:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1715205776.974945:0:17642:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff88009af27600/0xb608af4304ffddf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb608af4304ffddfa expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.974954:0:17642:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff88009af27600/0xb608af4304ffddf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb608af4304ffddfa expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.974959:0:17642:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff88009af27600/0xb608af4304ffddf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb608af4304ffddfa expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.974962:0:17642:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.108@tcp lock: ffff88009af27600/0xb608af4304ffddf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb608af4304ffddfa expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.974981:0:17642:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1715205776.974985:0:17642:0:(mgc_request.c:544:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1715205776.974992:0:17642:0:(import.c:157:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1715205776.974994:0:17642:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1715205776.974998:0:17642:0:(pinger.c:414:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1715205776.975002:0:6664:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715205776.975006:0:6664:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff88009af27600/0xb608af4304ffddf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb608af4304ffddfa expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1715205776.975006:0:17642:0:(import.c:86:import_set_state_nolock()) ffff88009c6c4800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1715205776.975012:0:6664:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009af27600 already unused, calling callback (ffffffffa02795c0) 00000100:00100000:3.0:1715205776.975013:0:17642:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800910e84c0 pname:cluuid:pid:xid:nid:opc:job umount:lustre-MDT0000-lwp-MDT0000_UUID:17642:1798520456043712:0@lo:39:umount.0 10000000:00010000:1.0:1715205776.975014:0:6664:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff88009af27600/0xb608af4304ffddf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb608af4304ffddfa expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.975020:0:6664:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff88009af27600/0xb608af4304ffddf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xb608af4304ffddfa expref: -99 pid: 14173 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1715205776.975024:0:6664:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff88009af27600/0xb608af4304ffddf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xb608af4304ffddfa expref: -99 pid: 14173 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1715205776.975028:0:6664:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1715205776.975029:0:6664:0:(mgc_request.c:1044:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1715205776.975031:0:6664:0:(mgc_request.c:153:config_log_put()) dropping config log lustre-client 00000100:00100000:3.0:1715205776.975035:0:17642:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1715205776.975044:0:6664:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.204.108@tcp lock: ffff88009af27600/0xb608af4304ffddf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000000 nid: local remote: 0xb608af4304ffddfa expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.975048:0:17642:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099b38480 going to sleep for 5 seconds 00010000:00010000:1.0:1715205776.975049:0:6664:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1715205776.975070:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456043712 00000100:00100000:0.0:1715205776.975093:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2146 00000100:00100000:0.0:1715205776.975097:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910e97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:17642:x1798520456043712:12345-0@lo:39:umount.0 00000020:00000080:0.0:1715205776.975112:0:14860:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xb608af4304ffdea9 00000100:00080000:0.0:1715205776.975122:0:14860:0:(import.c:86:import_set_state_nolock()) ffff88008b9f6800 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00010000:00000080:0.0:1715205776.975167:0:14860:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800910e97c0 x1798520456043712/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:557/0 lens 224/224 e 0 to 0 dl 1715205782 ref 1 fl Interpret:/0/0 rc 0/0 job:'umount.0' 00000100:00100000:0.0:1715205776.975197:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910e97c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:17642:x1798520456043712:12345-0@lo:39:umount.0 Request processed in 101us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.975201:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2146 00000020:00000080:0.0:1715205776.975205:0:14860:0:(genops.c:985:class_export_put()) final put ffff88008b9f4800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1715205776.975213:0:6664:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff88009af27600/0xb608af4304ffddf3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000000 nid: local remote: 0xb608af4304ffddfa expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.975213:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f110980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:56327ea4-9f7e-4a68-8b95-1797b1ed350d:2852:1798520456043776:0@lo:103:ldlm_bl_01.0 00010000:00010000:1.0:1715205776.975218:0:6664:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff88009af27600/0xb608af4304ffddf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000000 nid: local remote: 0xb608af4304ffddfa expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.975226:0:6664:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205776.975227:0:6664:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205776.975228:0:6664:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205776.975231:0:11161:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715205776.975235:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1715205776.975244:0:14676:0:(genops.c:944:class_export_destroy()) destroying export ffff88008b9f4800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:2.0:1715205776.975253:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456043776 00000100:00100000:2.0:1715205776.975269:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:2.0:1715205776.975272:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6deda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56327ea4-9f7e-4a68-8b95-1797b1ed350d+18:2852:x1798520456043776:12345-0@lo:103:ldlm_bl_01.0 00010000:00010000:2.0:1715205776.975277:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.975284:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009af246c0/0xb608af4304ffddfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb608af4304ffddf3 expref: 18 pid: 14179 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.975292:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:3.0:1715205776.975299:0:14676:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff88008b9f6800 for lustre-MDT0000 00000100:00100000:2.0:1715205776.975308:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6deda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56327ea4-9f7e-4a68-8b95-1797b1ed350d+17:2852:x1798520456043776:12345-0@lo:103:ldlm_bl_01.0 Request processed in 35us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.975311:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.975312:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:3.0:1715205776.975316:0:17642:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800910e84c0 pname:cluuid:pid:xid:nid:opc:job umount:lustre-MDT0000-lwp-MDT0000_UUID:17642:1798520456043712:0@lo:39:umount.0 00000100:00100000:1.0:1715205776.975324:0:14860:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455815296 00000100:00080000:3.0:1715205776.975324:0:17642:0:(import.c:86:import_set_state_nolock()) ffff88009c6c4800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1715205776.975326:0:17642:0:(import.c:157:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1715205776.975327:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f110980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:56327ea4-9f7e-4a68-8b95-1797b1ed350d:2852:1798520456043776:0@lo:103:ldlm_bl_01.0 00000100:00100000:3.0:1715205776.975327:0:17642:0:(client.c:2892:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1715205776.975329:0:17642:0:(import.c:339:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1715205776.975338:0:14860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 2147 00000100:00100000:1.0:1715205776.975341:0:14860:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f623dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+233:11754:x1798520455815296:12345-192.168.204.8@tcp:101:dbench.0 00010000:00010000:1.0:1715205776.975349:0:14860:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1715205776.975355:0:14860:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500895e lrc: 2/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd00cff7d5b23f08 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.975380:0:14860:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305008965 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.975386:0:14860:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305008950 lrc: 2/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23f01 expref: 234 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.975390:0:14860:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305008965 lrc: 4/1,0 mode: --/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.975401:0:14860:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305008950 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23f01 expref: 234 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.975407:0:14860:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305008950 lrc: 4/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23f01 expref: 234 pid: 14185 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.975414:0:14860:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f111300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456043840:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.975446:0:14860:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b4b93e40 going to sleep for 6 seconds 00010000:00010000:3.0:1715205776.976077:0:17642:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff880099ae4b40/0xb608af4304ffdd44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb608af4304ffdd4b expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.976082:0:17642:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff880099ae4b40/0xb608af4304ffdd44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb608af4304ffdd4b expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.976086:0:17642:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff880099ae4b40/0xb608af4304ffdd44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb608af4304ffdd4b expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.976089:0:17642:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.108@tcp lock: ffff880099ae4b40/0xb608af4304ffdd44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xb608af4304ffdd4b expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.976098:0:14860:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f111300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14860:1798520456043840:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.976100:0:17642:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1715205776.976103:0:17642:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff88009af27840/0xb608af4304ffde1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb608af4304ffde24 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.976107:0:14860:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305008965 lrc: 3/1,0 mode: --/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.976107:0:17642:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff88009af27840/0xb608af4304ffde1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb608af4304ffde24 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.976108:0:6569:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1715205776.976110:0:17642:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff88009af27840/0xb608af4304ffde1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb608af4304ffde24 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.976112:0:6569:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff880099ae4b40/0xb608af4304ffdd44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb608af4304ffdd4b expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.976114:0:17642:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.108@tcp lock: ffff88009af27840/0xb608af4304ffde1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb608af4304ffde24 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.976117:0:6569:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099ae4b40 already unused, calling callback (ffffffffa02795c0) 10000000:00010000:2.0:1715205776.976119:0:6569:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff880099ae4b40/0xb608af4304ffdd44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb608af4304ffdd4b expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.976123:0:6569:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff880099ae4b40/0xb608af4304ffdd44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xb608af4304ffdd4b expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.976126:0:17642:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:00010000:2.0:1715205776.976127:0:6569:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff880099ae4b40/0xb608af4304ffdd44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xb608af4304ffdd4b expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.976129:0:17642:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff880099ae73c0/0xb608af4304ffdde5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb608af4304ffddec expref: -99 pid: 14173 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1715205776.976131:0:6569:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1715205776.976132:0:6569:0:(mgc_request.c:1044:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1715205776.976133:0:17642:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff880099ae73c0/0xb608af4304ffdde5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb608af4304ffddec expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.976136:0:17642:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff880099ae73c0/0xb608af4304ffdde5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb608af4304ffddec expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.976139:0:17642:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.108@tcp lock: ffff880099ae73c0/0xb608af4304ffdde5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb608af4304ffddec expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.976141:0:6569:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.204.108@tcp lock: ffff880099ae4b40/0xb608af4304ffdd44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000000 nid: local remote: 0xb608af4304ffdd4b expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.976146:0:6569:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1715205776.976146:0:17642:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1715205776.976148:0:17642:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.108@tcp lock: ffff880099ae4900/0xb608af4304ffdd36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb608af4304ffdd3d expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.976155:0:17642:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff880099ae4900/0xb608af4304ffdd36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb608af4304ffdd3d expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.976158:0:17642:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.108@tcp lock: ffff880099ae4900/0xb608af4304ffdd36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb608af4304ffdd3d expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.976161:0:17642:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.108@tcp lock: ffff880099ae4900/0xb608af4304ffdd36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb608af4304ffdd3d expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.976162:0:6569:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff880099ae4b40/0xb608af4304ffdd44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000000 nid: local remote: 0xb608af4304ffdd4b expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.976166:0:6569:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff880099ae4b40/0xb608af4304ffdd44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000000 nid: local remote: 0xb608af4304ffdd4b expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.976166:0:17642:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1715205776.976168:0:17642:0:(mgc_request.c:153:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1715205776.976170:0:17642:0:(mgc_request.c:544:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:1.0:1715205776.976173:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6deed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:56327ea4-9f7e-4a68-8b95-1797b1ed350d:2853:1798520456043904:0@lo:103:ldlm_bl_05.0 00010000:00010000:2.0:1715205776.976175:0:6569:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000020:01000004:3.0:1715205776.976175:0:17642:0:(obd_mount_server.c:1629:server_put_super()) stopping lustre-MDT0000 00010000:00010000:2.0:1715205776.976176:0:6569:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff88009af27840/0xb608af4304ffde1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb608af4304ffde24 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 00000020:01000000:3.0:1715205776.976177:0:17642:0:(obd_config.c:2324:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1715205776.976179:0:17642:0:(obd_config.c:1384:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1715205776.976180:0:6569:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88009af27840 already unused, calling callback (ffffffffa02795c0) 10000000:00010000:2.0:1715205776.976181:0:6569:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff88009af27840/0xb608af4304ffde1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb608af4304ffde24 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 00000020:02000400:3.0:1715205776.976181:0:17642:0:(obd_config.c:854:class_cleanup()) Failing over lustre-MDT0000 00000004:00000080:3.0:1715205776.976183:0:17642:0:(mdt_handler.c:7411:mdt_iocontrol()) handling ioctl cmd 0x40086672 00000100:00100000:1.0:1715205776.976188:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1715205776.976189:0:6569:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff88009af27840/0xb608af4304ffde1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb608af4304ffde24 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1715205776.976192:0:6569:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff88009af27840/0xb608af4304ffde1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb608af4304ffde24 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1715205776.976196:0:6569:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1715205776.976197:0:6569:0:(mgc_request.c:1044:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1715205776.976199:0:6569:0:(mgc_request.c:153:config_log_put()) dropping config log lustre-mdtir 00000100:00100000:1.0:1715205776.976206:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456043904 00010000:00010000:2.0:1715205776.976208:0:6569:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.204.108@tcp lock: ffff88009af27840/0xb608af4304ffde1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb608af4304ffde24 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.976212:0:6569:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1715205776.976218:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00010000:00010000:2.0:1715205776.976218:0:6569:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff88009af27840/0xb608af4304ffde1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb608af4304ffde24 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.976220:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a707f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56327ea4-9f7e-4a68-8b95-1797b1ed350d+17:2853:x1798520456043904:12345-0@lo:103:ldlm_bl_05.0 00010000:00010000:2.0:1715205776.976222:0:6569:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff88009af27840/0xb608af4304ffde1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb608af4304ffde24 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.976226:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.976229:0:6569:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1715205776.976230:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009af24d80/0xb608af4304ffdd4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb608af4304ffdd44 expref: 17 pid: 14180 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.976230:0:6569:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff880099ae73c0/0xb608af4304ffdde5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb608af4304ffddec expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.976234:0:8314:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1715205776.976234:0:6569:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099ae73c0 already unused, calling callback (ffffffffa02795c0) 10000000:00010000:2.0:1715205776.976235:0:6569:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff880099ae73c0/0xb608af4304ffdde5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb608af4304ffddec expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.976236:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.976237:0:8314:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.108@tcp lock: ffff880099ae4900/0xb608af4304ffdd36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb608af4304ffdd3d expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.976239:0:6569:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff880099ae73c0/0xb608af4304ffdde5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb608af4304ffddec expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.976243:0:8314:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880099ae4900 already unused, calling callback (ffffffffa02795c0) 10000000:00010000:2.0:1715205776.976243:0:6569:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff880099ae73c0/0xb608af4304ffdde5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb608af4304ffddec expref: -99 pid: 14173 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1715205776.976244:0:8314:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.108@tcp lock: ffff880099ae4900/0xb608af4304ffdd36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb608af4304ffdd3d expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.976244:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a707f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56327ea4-9f7e-4a68-8b95-1797b1ed350d+16:2853:x1798520456043904:12345-0@lo:103:ldlm_bl_05.0 Request processed in 24us (56us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.976247:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 10000000:01000000:2.0:1715205776.976247:0:6569:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1715205776.976248:0:6569:0:(mgc_request.c:1044:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1715205776.976250:0:6569:0:(mgc_request.c:153:config_log_put()) dropping config log params 00010000:00010000:2.0:1715205776.976257:0:6569:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.204.108@tcp lock: ffff880099ae73c0/0xb608af4304ffdde5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb608af4304ffddec expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.976261:0:6569:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1715205776.976267:0:6569:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff880099ae73c0/0xb608af4304ffdde5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb608af4304ffddec expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.976270:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6deed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:56327ea4-9f7e-4a68-8b95-1797b1ed350d:2853:1798520456043904:0@lo:103:ldlm_bl_05.0 00010000:00010000:2.0:1715205776.976270:0:6569:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff880099ae73c0/0xb608af4304ffdde5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb608af4304ffddec expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.976276:0:2853:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1715205776.976276:0:6569:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715205776.976277:0:6569:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715205776.976279:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6decc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:56327ea4-9f7e-4a68-8b95-1797b1ed350d:2853:1798520456043968:0@lo:103:ldlm_bl_05.0 00010000:00010000:2.0:1715205776.976279:0:6569:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1715205776.976282:0:6665:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715205776.976287:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715205776.976290:0:8314:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.108@tcp lock: ffff880099ae4900/0xb608af4304ffdd36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb608af4304ffdd3d expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.976290:0:2851:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6ded0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:56327ea4-9f7e-4a68-8b95-1797b1ed350d:2851:1798520456044032:0@lo:103:ldlm_bl_05.0 10000000:00010000:0.0:1715205776.976294:0:8314:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.108@tcp lock: ffff880099ae4900/0xb608af4304ffdd36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb608af4304ffdd3d expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.976294:0:6664:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1715205776.976297:0:6662:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456043968 10000000:01000000:0.0:1715205776.976301:0:8314:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1715205776.976303:0:8314:0:(mgc_request.c:1044:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1715205776.976304:0:8314:0:(mgc_request.c:153:config_log_put()) dropping config log lustre-barrier 00000100:00100000:1.0:1715205776.976306:0:6662:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:2.0:1715205776.976307:0:2851:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1715205776.976308:0:6662:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f111300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56327ea4-9f7e-4a68-8b95-1797b1ed350d+16:2853:x1798520456043968:12345-0@lo:103:ldlm_bl_05.0 00010000:00010000:1.0:1715205776.976311:0:6662:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.976314:0:6662:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009af27a80/0xb608af4304ffde24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb608af4304ffde1d expref: 16 pid: 14180 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.976315:0:8314:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.204.108@tcp lock: ffff880099ae4900/0xb608af4304ffdd36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb608af4304ffdd3d expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.976319:0:8314:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1715205776.976319:0:6662:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1715205776.976327:0:8314:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.108@tcp lock: ffff880099ae4900/0xb608af4304ffdd36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb608af4304ffdd3d expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.976328:0:6662:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f111300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56327ea4-9f7e-4a68-8b95-1797b1ed350d+15:2853:x1798520456043968:12345-0@lo:103:ldlm_bl_05.0 Request processed in 19us (40us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.976328:0:7383:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456044032 00010000:00010000:0.0:1715205776.976330:0:8314:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.108@tcp lock: ffff880099ae4900/0xb608af4304ffdd36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb608af4304ffdd3d expref: -99 pid: 14173 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.976331:0:6662:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:1.0:1715205776.976339:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6decc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:56327ea4-9f7e-4a68-8b95-1797b1ed350d:2853:1798520456043968:0@lo:103:ldlm_bl_05.0 00010000:00010000:0.0:1715205776.976340:0:8314:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205776.976341:0:8314:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205776.976343:0:8314:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1715205776.976344:0:7383:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:2.0:1715205776.976347:0:7383:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6debdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:56327ea4-9f7e-4a68-8b95-1797b1ed350d+15:2851:x1798520456044032:12345-0@lo:103:ldlm_bl_05.0 00010000:00010000:2.0:1715205776.976353:0:7383:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.976359:0:7383:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009af24fc0/0xb608af4304ffddec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb608af4304ffdde5 expref: 15 pid: 14180 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.976365:0:7383:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205776.976380:0:7383:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6debdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:56327ea4-9f7e-4a68-8b95-1797b1ed350d+14:2851:x1798520456044032:12345-0@lo:103:ldlm_bl_05.0 Request processed in 32us (73us total) trans 0 rc 0/0 00000100:00100000:0.0:1715205776.976386:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:2.0:1715205776.976387:0:7383:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:2.0:1715205776.976401:0:7383:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455815360 00000100:00100000:2.0:1715205776.976403:0:7383:0:(service.c:1220:ptlrpc_check_req()) Dropping req ffff88009f622140 for failed obd lustre-MDT0000 00000100:00080000:2.0:1715205776.976406:0:7383:0:(niobuf.c:609:ptlrpc_send_reply()) sending ENODEV from failed obd 5 00000100:00100000:2.0:1715205776.976432:0:2851:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6ded0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:56327ea4-9f7e-4a68-8b95-1797b1ed350d:2851:1798520456044032:0@lo:103:ldlm_bl_05.0 00000100:00100000:2.0:1715205776.976439:0:2851:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1715205776.976443:0:2851:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009f624c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:56327ea4-9f7e-4a68-8b95-1797b1ed350d:2851:1798520456044096:0@lo:103:ldlm_bl_03.0 00000100:00100000:2.0:1715205776.976455:0:2851:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715205776.976465:0:7383:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456044096 00000100:00100000:2.0:1715205776.976475:0:7383:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:2.0:1715205776.976476:0:7383:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6ded0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:56327ea4-9f7e-4a68-8b95-1797b1ed350d+14:2851:x1798520456044096:12345-0@lo:103:ldlm_bl_03.0 00010000:00010000:2.0:1715205776.976479:0:7383:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1715205776.976484:0:7383:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009af26d00/0xb608af4304ffdd3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb608af4304ffdd36 expref: 14 pid: 14180 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.976490:0:7383:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1715205776.976501:0:7383:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6ded0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:56327ea4-9f7e-4a68-8b95-1797b1ed350d+13:2851:x1798520456044096:12345-0@lo:103:ldlm_bl_03.0 Request processed in 24us (46us total) trans 0 rc 0/0 00000100:00100000:2.0:1715205776.976506:0:7383:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:2.0:1715205776.976662:0:2851:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009f624c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:56327ea4-9f7e-4a68-8b95-1797b1ed350d:2851:1798520456044096:0@lo:103:ldlm_bl_03.0 00000100:00100000:2.0:1715205776.980994:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.981019:0:14185:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455815424 00000100:00100000:3.0:1715205776.981024:0:14185:0:(service.c:1220:ptlrpc_check_req()) Dropping req ffff8800a6dec740 for failed obd lustre-MDT0000 00000100:00080000:3.0:1715205776.981030:0:14185:0:(niobuf.c:609:ptlrpc_send_reply()) sending ENODEV from failed obd 5 00000001:00080000:1.0:1715205776.982860:0:17294:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-MDT0000: transno 330712482813 is committed 00000001:00080000:0.0:1715205776.982863:0:14242:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-MDT0000: transno 330712482815 is committed 00000004:00080000:1.0:1715205776.982889:0:17294:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:1.0:1715205776.982900:0:17294:0:(osp_sync.c:1627:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000100:00100000:3.0:1715205776.982968:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6decc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2853:1798520456044160:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1715205776.982982:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6deed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2854:1798520456044224:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1715205776.983000:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1715205776.983005:0:2851:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6ded580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2851:1798520456044288:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1715205776.983019:0:2851:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715205776.983033:0:19961:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456044160 00000100:00100000:2.0:1715205776.983039:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1715205776.983054:0:19961:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456044288 00000100:00100000:2.0:1715205776.983056:0:32666:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456044224 00000100:00100000:0.0:1715205776.983060:0:20898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14706 00000100:00100000:0.0:1715205776.983065:0:20898:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910e84c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:2853:x1798520456044160:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1715205776.983069:0:19961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14707 00000100:00100000:2.0:1715205776.983073:0:32666:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14708 00000100:00100000:3.0:1715205776.983073:0:19961:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6deda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:2851:x1798520456044288:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1715205776.983076:0:32666:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d445a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+7:2854:x1798520456044224:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1715205776.983084:0:20898:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:5594 count 1 00002000:00080000:3.0:1715205776.983084:0:19961:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:5596 count 1 00002000:00080000:2.0:1715205776.983085:0:32666:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:5593 count 1 00000100:00100000:1.0:1715205776.983086:0:2851:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f110980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2851:1798520456044544:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1715205776.983098:0:20898:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c83f840/0xb608af4305008973 lrc: 3/0,1 mode: --/PW res: [0x15da:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.983098:0:32666:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091378900/0xb608af430500896c lrc: 3/0,1 mode: --/PW res: [0x15d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.983098:0:19961:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a73ae1c0/0xb608af430500897a lrc: 3/0,1 mode: --/PW res: [0x15dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.983106:0:2851:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715205776.983111:0:20898:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009eedd8c0/0xb608af430500746c lrc: 2/0,0 mode: PW/PW res: [0x15da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23721 expref: 45 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.983111:0:32666:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bd99d40/0xb608af4305007227 lrc: 2/0,0 mode: PW/PW res: [0x15d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2363a expref: 45 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.983112:0:19961:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c83c6c0/0xb608af4305007ead lrc: 2/0,0 mode: PW/PW res: [0x15dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b0a expref: 45 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.983117:0:20898:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1715205776.983117:0:2851:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1715205776.983117:0:32666:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1715205776.983118:0:20898:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1715205776.983118:0:32666:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1715205776.983118:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1715205776.983119:0:19961:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1715205776.983120:0:20898:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c83f840/0xb608af4305008973 lrc: 4/0,1 mode: --/PW res: [0x15da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.983120:0:32666:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091378900/0xb608af430500896c lrc: 4/0,1 mode: --/PW res: [0x15d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.983120:0:19961:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a73ae1c0/0xb608af430500897a lrc: 4/0,1 mode: --/PW res: [0x15dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.983121:0:2851:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f115a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2851:1798520456044352:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1715205776.983135:0:2851:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715205776.983137:0:20898:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009eedd8c0/0xb608af430500746c lrc: 3/0,0 mode: PW/PW res: [0x15da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23721 expref: 45 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.983138:0:32666:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bd99d40/0xb608af4305007227 lrc: 3/0,0 mode: PW/PW res: [0x15d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2363a expref: 45 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.983138:0:19961:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c83c6c0/0xb608af4305007ead lrc: 3/0,0 mode: PW/PW res: [0x15dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b0a expref: 45 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.983144:0:20898:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009eedd8c0/0xb608af430500746c lrc: 4/0,0 mode: PW/PW res: [0x15da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23721 expref: 45 pid: 20898 timeout: 3136 lvb_type: 0 00010000:00010000:2.0:1715205776.983146:0:32666:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bd99d40/0xb608af4305007227 lrc: 4/0,0 mode: PW/PW res: [0x15d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2363a expref: 45 pid: 19961 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.983146:0:19961:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c83c6c0/0xb608af4305007ead lrc: 4/0,0 mode: PW/PW res: [0x15dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b0a expref: 45 pid: 19961 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.983151:0:8300:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456044544 00000100:00100000:0.0:1715205776.983152:0:20898:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6217c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20898:1798520456044672:192.168.204.8@tcp:104: 00000100:00100000:2.0:1715205776.983153:0:32666:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d443900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:32666:1798520456044608:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.983154:0:19961:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880134ad1300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:19961:1798520456044736:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.983164:0:8300:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456044352 00000100:00100000:1.0:1715205776.983173:0:8300:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14709 00000100:00100000:1.0:1715205776.983175:0:8300:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f115580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:2851:x1798520456044544:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1715205776.983177:0:32666:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a6ddd840 going to sleep for 6 seconds 00000100:00100000:0.0:1715205776.983178:0:20898:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a6dc6780 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.983183:0:19961:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099b38600 going to sleep for 6 seconds 00002000:00080000:1.0:1715205776.983185:0:8300:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:6075 count 1 00000100:00100000:0.0:1715205776.983191:0:32645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14710 00000100:00100000:0.0:1715205776.983194:0:32645:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4c76c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:2851:x1798520456044352:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1715205776.983196:0:8300:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b59c000/0xb608af4305008981 lrc: 3/0,1 mode: --/PW res: [0x17bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.983199:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f112ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2853:1798520456044416:0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1715205776.983205:0:32645:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:6072 count 1 00010000:00010000:1.0:1715205776.983206:0:8300:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af4305007c7d lrc: 2/0,0 mode: PW/PW res: [0x17bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a31 expref: 41 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.983211:0:8300:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1715205776.983212:0:8300:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1715205776.983213:0:8300:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b59c000/0xb608af4305008981 lrc: 4/0,1 mode: --/PW res: [0x17bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.983214:0:32645:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c83cfc0/0xb608af4305008988 lrc: 3/0,1 mode: --/PW res: [0x17b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.983215:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715205776.983222:0:32645:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1d40/0xb608af4305006c3f lrc: 2/0,0 mode: PW/PW res: [0x17b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2342d expref: 41 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.983226:0:32645:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1715205776.983226:0:8300:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af4305007c7d lrc: 3/0,0 mode: PW/PW res: [0x17bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a31 expref: 41 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.983227:0:32645:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1715205776.983228:0:32645:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c83cfc0/0xb608af4305008988 lrc: 4/0,1 mode: --/PW res: [0x17b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.983228:0:2853:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1715205776.983231:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1176c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2853:1798520456044480:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1715205776.983233:0:8300:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af4305007c7d lrc: 4/0,0 mode: PW/PW res: [0x17bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a31 expref: 41 pid: 20898 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.983241:0:8300:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d4c2ac0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8300:1798520456044800:192.168.204.8@tcp:104: 00010000:00010000:0.0:1715205776.983242:0:32645:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1d40/0xb608af4305006c3f lrc: 3/0,0 mode: PW/PW res: [0x17b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2342d expref: 41 pid: 19961 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.983243:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715205776.983250:0:32645:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1d40/0xb608af4305006c3f lrc: 4/0,0 mode: PW/PW res: [0x17b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2342d expref: 41 pid: 19961 timeout: 3136 lvb_type: 0 00000100:00100000:0.0:1715205776.983257:0:32645:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009f624740 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32645:1798520456044864:192.168.204.8@tcp:104: 00000100:00100000:3.0:1715205776.983259:0:2451:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456044416 00000100:00100000:1.0:1715205776.983261:0:8300:0:(client.c:2492:ptlrpc_set_wait()) set ffff88013087d9c0 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.983272:0:2451:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456044480 00000100:00100000:0.0:1715205776.983273:0:32645:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a6dc6c00 going to sleep for 6 seconds 00000100:00100000:1.0:1715205776.983275:0:11773:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14711 00000100:00100000:1.0:1715205776.983278:0:11773:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad63c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+8:2853:x1798520456044416:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1715205776.983282:0:2451:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14712 00000100:00100000:3.0:1715205776.983285:0:2451:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ad4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+8:2853:x1798520456044480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1715205776.983287:0:11773:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:6071 count 1 00010000:00010000:1.0:1715205776.983294:0:11773:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b59c240/0xb608af430500898f lrc: 3/0,1 mode: --/PW res: [0x17b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1715205776.983294:0:2451:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:6073 count 1 00010000:00010000:3.0:1715205776.983302:0:2451:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a73ad8c0/0xb608af4305008996 lrc: 3/0,1 mode: --/PW res: [0x17b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.983303:0:11773:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800940caf40/0xb608af43050069ad lrc: 2/0,0 mode: PW/PW res: [0x17b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2334d expref: 41 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.983308:0:11773:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1715205776.983308:0:11773:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1715205776.983309:0:11773:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b59c240/0xb608af430500898f lrc: 4/0,1 mode: --/PW res: [0x17b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.983310:0:2451:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bd99b00/0xb608af43050073cb lrc: 2/0,0 mode: PW/PW res: [0x17b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236db expref: 41 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.983315:0:2451:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1715205776.983316:0:2451:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1715205776.983317:0:2451:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a73ad8c0/0xb608af4305008996 lrc: 4/0,1 mode: --/PW res: [0x17b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 2451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.983322:0:11773:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800940caf40/0xb608af43050069ad lrc: 3/0,0 mode: PW/PW res: [0x17b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2334d expref: 41 pid: 19955 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.983328:0:11773:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800940caf40/0xb608af43050069ad lrc: 4/0,0 mode: PW/PW res: [0x17b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2334d expref: 41 pid: 19955 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.983330:0:2451:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bd99b00/0xb608af43050073cb lrc: 3/0,0 mode: PW/PW res: [0x17b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236db expref: 41 pid: 19961 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.983335:0:11773:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009274f6c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:11773:1798520456044928:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.983335:0:2451:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bd99b00/0xb608af43050073cb lrc: 4/0,0 mode: PW/PW res: [0x17b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236db expref: 41 pid: 19961 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.983342:0:2451:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009ce7bdc0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:2451:1798520456044992:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.983354:0:11773:0:(client.c:2492:ptlrpc_set_wait()) set ffff88013087d240 going to sleep for 6 seconds 00000100:00100000:3.0:1715205776.983358:0:2451:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099b38540 going to sleep for 6 seconds 00000020:00000080:2.0:1715205776.983394:0:17642:0:(obd_config.c:877:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 3/6 00000020:00080000:2.0:1715205776.983397:0:17642:0:(genops.c:1752:print_export_data()) lustre-MDT0000: ACTIVE ffff88008b9f2800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: (null) 0 stale:0 00000020:00080000:2.0:1715205776.983402:0:17642:0:(genops.c:1752:print_export_data()) lustre-MDT0000: ACTIVE ffff88008b9f0000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: (null) 0 stale:0 00000020:00080000:2.0:1715205776.983406:0:17642:0:(genops.c:1752:print_export_data()) lustre-MDT0000: ACTIVE ffff88009c2b0800 41bc1ae4-4825-48bc-b22e-9cbe8affc36b 192.168.204.8@tcp 129 (1 0 123) 0 0 0 0: (null) 330712482815 stale:0 00000020:00080000:2.0:1715205776.983412:0:17642:0:(genops.c:1525:class_disconnect_exports()) OBD device 5 (ffff88009cf03c90) has exports, disconnecting them 00000020:00080000:2.0:1715205776.983414:0:17642:0:(genops.c:1501:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff88008b9f2800), last request at 1715205772 00000020:00000080:2.0:1715205776.983419:0:17642:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xb608af4304ffdea2 00000100:00080000:2.0:1715205776.983423:0:17642:0:(import.c:86:import_set_state_nolock()) ffff88008b9f3000 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00010000:00010000:1.0:1715205776.983438:0:11161:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1715205776.983457:0:17642:0:(genops.c:1506:class_disconnect_export_list()) disconnected export at 0@lo (ffff88008b9f2800): rc 0 00000020:00000080:2.0:1715205776.983458:0:17642:0:(genops.c:985:class_export_put()) final put ffff88008b9f2800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1715205776.983464:0:17642:0:(genops.c:1501:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff88008b9f0000), last request at 1715205772 00000020:00000080:2.0:1715205776.983470:0:17642:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xb608af4304ffde9b 00000100:00080000:2.0:1715205776.983472:0:17642:0:(import.c:86:import_set_state_nolock()) ffff88008b9f0800 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00000020:00000080:3.0:1715205776.983473:0:14676:0:(genops.c:944:class_export_destroy()) destroying export ffff88008b9f2800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:0.0:1715205776.983484:0:6569:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1715205776.983491:0:17642:0:(genops.c:1506:class_disconnect_export_list()) disconnected export at 0@lo (ffff88008b9f0000): rc 0 00000020:00000080:2.0:1715205776.983493:0:17642:0:(genops.c:985:class_export_put()) final put ffff88008b9f0000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1715205776.983498:0:17642:0:(genops.c:1501:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.204.8@tcp (ffff88009c2b0800), last request at 1715205775 00000020:00000080:2.0:1715205776.983500:0:17642:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xb608af4304ffdd83 00000020:00000080:3.0:1715205776.983503:0:14676:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff88008b9f3000 for lustre-MDT0000 00000020:00010000:2.0:1715205776.983505:0:17642:0:(genops.c:1857:obd_stale_export_put()) Put export ffff88009c2b0800: total 1 00000100:00080000:2.0:1715205776.983506:0:17642:0:(import.c:86:import_set_state_nolock()) ffff88009c2b2000 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00000020:00000080:3.0:1715205776.983510:0:14676:0:(genops.c:944:class_export_destroy()) destroying export ffff88008b9f0000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00010000:0.0:1715205776.983514:0:6665:0:(genops.c:1843:obd_stale_export_get()) Get export ffff88009c2b0800: total 1 00000020:00000080:3.0:1715205776.983528:0:14676:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff88008b9f0800 for lustre-MDT0000 00010000:00010000:0.0:1715205776.983602:0:6665:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305008950 lrc: 3/0,0 mode: CW/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23f01 expref: 128 pid: 14185 timeout: 3136 lvb_type: 0 00000020:00080000:2.0:1715205776.983611:0:17642:0:(genops.c:1506:class_disconnect_export_list()) disconnected export at 192.168.204.8@tcp (ffff88009c2b0800): rc 0 00010000:00010000:0.0:1715205776.983631:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59e1c0/0xb608af4305008950 lrc: 0/0,0 mode: --/CW res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23f01 expref: 125 pid: 14185 timeout: 3136 lvb_type: 0 00010000:00010000:0.0:1715205776.983647:0:6665:0:(ldlm_lock.c:2634:ldlm_export_cancel_blocked_locks()) Export ffff88009c2b0800, canceled 1 locks, left on hash table 122. 00000020:00010000:0.0:1715205776.983649:0:6665:0:(genops.c:1857:obd_stale_export_put()) Put export ffff88009c2b0800: total 1 00000020:00010000:0.0:1715205776.983650:0:6665:0:(genops.c:1843:obd_stale_export_get()) Get export ffff88009c2b0800: total 1 00000100:00080000:2.0:1715205776.983650:0:17642:0:(import.c:157:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1715205776.983654:0:17642:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@ffff88012f110980 x1798520456044544/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205783 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'osp-syn-0-0.0' 00010000:00010000:0.0:1715205776.983659:0:6665:0:(ldlm_lock.c:2634:ldlm_export_cancel_blocked_locks()) Export ffff88009c2b0800, canceled 0 locks, left on hash table 122. 00000100:00100000:2.0:1715205776.983662:0:17642:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@ffff88012f115a40 x1798520456044352/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205783 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'osp-syn-0-0.0' 00000100:00100000:2.0:1715205776.983666:0:17642:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@ffff88012f112ac0 x1798520456044416/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205783 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'osp-syn-0-0.0' 00010000:00010000:0.0:1715205776.983671:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b883840/0xb608af4304ffe64a lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xef4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b1b500 expref: 124 pid: 14307 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.983672:0:17642:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@ffff88012f1176c0 x1798520456044480/t0(0) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205783 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'osp-syn-0-0.0' 00000004:00080000:1.0:1715205776.983674:0:2851:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff88012f115a40/1, rc -5, transno 0 00000100:00100000:2.0:1715205776.983676:0:17642:0:(client.c:2892:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:2.0:1715205776.983678:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88013147ed40 x1798520455992512/t30064771408(30064771408) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205778 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000100:00100000:1.0:1715205776.983680:0:2851:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f115a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2851:1798520456044352:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1715205776.983682:0:2853:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff88012f1176c0/1, rc -5, transno 0 00010000:00010000:0.0:1715205776.983683:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59b00/0xb608af43050063a2 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23108 expref: 123 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.983685:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f1176c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2853:1798520456044480:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1715205776.983687:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88013147ed40, transno 30064771408 00000100:00100000:2.0:1715205776.983690:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88013147f200 x1798520455992128/t30064771409(30064771409) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205778 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00010000:00010000:0.0:1715205776.983693:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3840/0xb608af4305004ab9 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xff9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2290c expref: 122 pid: 14185 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715205776.983694:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88013147f200, transno 30064771409 00000100:00100000:2.0:1715205776.983696:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88013147aac0 x1798520455992064/t30064771410(30064771410) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205778 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983700:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88013147aac0, transno 30064771410 00010000:00010000:0.0:1715205776.983702:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8240/0xb608af4305008417 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeed:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d10 expref: 121 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.983702:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff880131478e40 x1798520455992448/t30064771411(30064771411) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205778 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983706:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff880131478e40, transno 30064771411 00000100:00100000:2.0:1715205776.983708:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff880131479c80 x1798520455992384/t30064771412(30064771412) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205778 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983711:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff880131479c80, transno 30064771412 00000100:00100000:2.0:1715205776.983713:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8801314797c0 x1798520455992000/t30064771413(30064771413) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205778 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00010000:00010000:0.0:1715205776.983717:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0240/0xb608af43050044ca lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xec7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22714 expref: 120 pid: 14186 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715205776.983717:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8801314797c0, transno 30064771413 00000100:00100000:2.0:1715205776.983719:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8800910ef200 x1798520455992832/t30064771414(30064771414) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205778 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983733:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800910ef200, transno 30064771414 00000100:00100000:2.0:1715205776.983736:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88009a485a40 x1798520455993024/t30064771415(30064771415) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205778 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983739:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88009a485a40, transno 30064771415 00010000:00010000:0.0:1715205776.983740:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a610480/0xb608af4305008598 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xef3:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d9c expref: 119 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.983742:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8800a66dd580 x1798520455991936/t30064771416(30064771416) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205778 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983746:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a66dd580, transno 30064771416 00000100:00100000:2.0:1715205776.983748:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88009a485f00 x1798520455992960/t30064771417(30064771417) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205778 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00010000:00010000:0.0:1715205776.983750:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5aac0/0xb608af430500149c lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xed4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b218a4 expref: 118 pid: 14185 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715205776.983752:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88009a485f00, transno 30064771417 00000100:00100000:2.0:1715205776.983755:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88009ce7da40 x1798520456003072/t30064771418(30064771418) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983758:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88009ce7da40, transno 30064771418 00010000:00010000:0.0:1715205776.983760:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2d00/0xb608af4305005697 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebf:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22ca8 expref: 117 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.983761:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88009f6204c0 x1798520456002752/t30064771419(30064771419) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983765:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88009f6204c0, transno 30064771419 00010000:00010000:0.0:1715205776.983768:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8480/0xb608af430500845d lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeef:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d2c expref: 116 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.983768:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88009ce7e3c0 x1798520456002944/t30064771420(30064771420) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983771:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88009ce7e3c0, transno 30064771420 00000100:00100000:2.0:1715205776.983774:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88009ce7a140 x1798520456003136/t30064771421(30064771421) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00010000:00010000:0.0:1715205776.983779:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009137a640/0xb608af4305008893 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23eb4 expref: 115 pid: 14185 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715205776.983779:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88009ce7a140, transno 30064771421 00000100:00100000:2.0:1715205776.983781:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88009ce7d580 x1798520456003008/t30064771422(30064771422) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983785:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88009ce7d580, transno 30064771422 00000100:00100000:2.0:1715205776.983787:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88009f622ac0 x1798520456002880/t30064771423(30064771423) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00010000:00010000:0.0:1715205776.983790:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7596d00/0xb608af430500554e lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22c38 expref: 114 pid: 14185 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715205776.983791:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88009f622ac0, transno 30064771423 00000100:00100000:2.0:1715205776.983794:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88009f625a40 x1798520456002688/t30064771424(30064771424) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983798:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88009f625a40, transno 30064771424 00010000:00010000:0.0:1715205776.983800:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59cfc0/0xb608af430500107b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xed0:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21738 expref: 113 pid: 14186 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.983800:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88009f620980 x1798520456002816/t30064771425(30064771425) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983804:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88009f620980, transno 30064771425 00000100:00100000:2.0:1715205776.983807:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8800910edf00 x1798520456003712/t30064771426(30064771426) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00010000:00010000:0.0:1715205776.983809:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb58fc0/0xb608af43050066ce lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2323c expref: 112 pid: 14185 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715205776.983811:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800910edf00, transno 30064771426 00000100:00100000:2.0:1715205776.983814:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88012c2250c0 x1798520456003776/t30064771427(30064771427) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00010000:00010000:0.0:1715205776.983818:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099172880/0xb608af4305005ca9 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xec1:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22ebc expref: 111 pid: 14185 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715205776.983818:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88012c2250c0, transno 30064771427 00000100:00100000:2.0:1715205776.983820:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8801372f9c80 x1798520456004608/t30064771428(30064771428) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983824:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8801372f9c80, transno 30064771428 00010000:00010000:0.0:1715205776.983827:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb3c0/0xb608af43050084a3 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeeb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d48 expref: 110 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.983827:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88013711a140 x1798520456005120/t30064771429(30064771429) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983831:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88013711a140, transno 30064771429 00000100:00100000:2.0:1715205776.983833:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88013711b440 x1798520456005184/t30064771430(30064771430) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983837:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88013711b440, transno 30064771430 00010000:00010000:0.0:1715205776.983839:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb58480/0xb608af4305001678 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xed5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2194c expref: 109 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.983839:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88013711c740 x1798520456004800/t30064771431(30064771431) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983843:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88013711c740, transno 30064771431 00000100:00100000:2.0:1715205776.983846:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8801372fe3c0 x1798520456004544/t30064771432(30064771432) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00010000:00010000:0.0:1715205776.983849:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091587a80/0xb608af4304fff7d8 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xed7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b20ecc expref: 108 pid: 14869 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715205776.983850:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8801372fe3c0, transno 30064771432 00000100:00100000:2.0:1715205776.983852:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88013711cc00 x1798520456005824/t30064771433(30064771433) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983856:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88013711cc00, transno 30064771433 00010000:00010000:0.0:1715205776.983857:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091379440/0xb608af43050088d9 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ed0 expref: 107 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.983859:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8800a61b17c0 x1798520456006272/t30064771434(30064771434) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983863:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a61b17c0, transno 30064771434 00000100:00100000:2.0:1715205776.983866:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88009ce79c80 x1798520456006144/t30064771435(30064771435) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00010000:00010000:0.0:1715205776.983868:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940ca400/0xb608af4305003aeb lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xede:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22554 expref: 106 pid: 14185 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715205776.983870:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88009ce79c80, transno 30064771435 00000100:00100000:2.0:1715205776.983873:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8800a66df200 x1798520456004352/t30064771436(30064771436) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983877:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a66df200, transno 30064771436 00010000:00010000:0.0:1715205776.983878:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedd680/0xb608af43050010cf lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xed1:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21754 expref: 105 pid: 14186 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.983880:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff880134ad6d40 x1798520456006656/t30064771437(30064771437) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983884:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff880134ad6d40, transno 30064771437 00000100:00100000:2.0:1715205776.983887:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8800a6a48000 x1798520456007616/t30064771438(30064771438) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00010000:00010000:0.0:1715205776.983888:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada880/0xb608af4305000687 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b213d4 expref: 104 pid: 14186 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715205776.983891:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a6a48000, transno 30064771438 00000100:00100000:2.0:1715205776.983894:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88013711a600 x1798520456006976/t30064771439(30064771439) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983898:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88013711a600, transno 30064771439 00000100:00100000:2.0:1715205776.983901:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88013711e880 x1798520456007232/t30064771440(30064771440) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983905:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88013711e880, transno 30064771440 00000100:00100000:2.0:1715205776.983908:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff880134ad0980 x1798520456006720/t30064771441(30064771441) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983912:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff880134ad0980, transno 30064771441 00000100:00100000:2.0:1715205776.983914:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff880134ad0e40 x1798520456006592/t30064771442(30064771442) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983918:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff880134ad0e40, transno 30064771442 00000100:00100000:2.0:1715205776.983921:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88009a4863c0 x1798520456007808/t30064771443(30064771443) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983925:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88009a4863c0, transno 30064771443 00000100:00100000:2.0:1715205776.983927:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff880134ad5a40 x1798520456007936/t30064771444(30064771444) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983932:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff880134ad5a40, transno 30064771444 00000100:00100000:2.0:1715205776.983934:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88012d4476c0 x1798520456008064/t30064771445(30064771445) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205780 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983939:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88012d4476c0, transno 30064771445 00000100:00100000:2.0:1715205776.983942:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88009edb2f80 x1798520456014720/t30064771448(30064771448) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205781 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983946:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88009edb2f80, transno 30064771448 00000100:00100000:2.0:1715205776.983948:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88009edb6880 x1798520456014912/t30064771449(30064771449) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205781 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983952:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88009edb6880, transno 30064771449 00000100:00100000:2.0:1715205776.983955:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8800a66db900 x1798520456015104/t30064771450(30064771450) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205781 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00010000:00010000:0.0:1715205776.983959:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7597180/0xb608af43050052ae lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeca:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22b58 expref: 103 pid: 14860 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715205776.983959:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a66db900, transno 30064771450 00000100:00100000:2.0:1715205776.983963:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88009edb7200 x1798520456014848/t30064771451(30064771451) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205781 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983967:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88009edb7200, transno 30064771451 00000100:00100000:2.0:1715205776.983970:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8800a66d8000 x1798520456015168/t30064771452(30064771452) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205781 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00010000:00010000:0.0:1715205776.983971:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7596f40/0xb608af4305005134 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22ae8 expref: 102 pid: 14184 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715205776.983974:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a66d8000, transno 30064771452 00000100:00100000:2.0:1715205776.983977:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88009edb0e40 x1798520456014784/t30064771453(30064771453) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205781 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00010000:00010000:0.0:1715205776.983981:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59dd40/0xb608af430500891f lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23eec expref: 101 pid: 14185 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715205776.983981:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88009edb0e40, transno 30064771453 00000100:00100000:2.0:1715205776.983984:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8800a66da600 x1798520456015040/t30064771454(30064771454) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205781 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.983988:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a66da600, transno 30064771454 00000100:00100000:2.0:1715205776.983991:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8800a66de3c0 x1798520456014976/t30064771455(30064771455) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205781 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00010000:00010000:0.0:1715205776.983992:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800940c9680/0xb608af4305003b70 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22570 expref: 100 pid: 14185 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715205776.983995:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a66de3c0, transno 30064771455 00000100:00100000:2.0:1715205776.983999:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff880134ad4740 x1798520456015808/t30064771456(30064771456) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205781 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00010000:00010000:0.0:1715205776.984002:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091587600/0xb608af4305001123 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xed2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21770 expref: 99 pid: 14186 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715205776.984003:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff880134ad4740, transno 30064771456 00000100:00100000:2.0:1715205776.984006:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8800a1776d40 x1798520456016000/t30064771457(30064771457) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205781 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00010000:00010000:0.0:1715205776.984011:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800915873c0/0xb608af43050006e2 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xef5:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b213f0 expref: 98 pid: 14185 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715205776.984011:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a1776d40, transno 30064771457 00000100:00100000:2.0:1715205776.984013:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff880134ad4280 x1798520456015744/t30064771458(30064771458) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205781 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.984017:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff880134ad4280, transno 30064771458 00010000:00010000:0.0:1715205776.984020:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091586400/0xb608af4304fff9c2 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xed9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b20f74 expref: 97 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.984020:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff880134ad3900 x1798520456015872/t30064771459(30064771459) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205781 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.984023:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff880134ad3900, transno 30064771459 00000100:00100000:2.0:1715205776.984026:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8800a1774280 x1798520456016448/t30064771460(30064771460) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205781 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00010000:00010000:0.0:1715205776.984030:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b881440/0xb608af4304ffe620 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b1b0f4 expref: 96 pid: 14307 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715205776.984030:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a1774280, transno 30064771460 00000100:00100000:2.0:1715205776.984032:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8800a1772140 x1798520456016384/t30064771461(30064771461) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205781 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.984036:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a1772140, transno 30064771461 00010000:00010000:0.0:1715205776.984039:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5b3c0/0xb608af430500292c lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21f81 expref: 95 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.984039:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8800a17717c0 x1798520456016320/t30064771462(30064771462) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205781 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.984043:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a17717c0, transno 30064771462 00000100:00100000:2.0:1715205776.984046:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8800a17750c0 x1798520456016256/t30064771463(30064771463) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205781 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.984050:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a17750c0, transno 30064771463 00010000:00010000:0.0:1715205776.984051:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acfc0/0xb608af4305008838 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e91 expref: 94 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.984053:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8800a1770980 x1798520456016768/t30064771464(30064771464) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205781 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.984057:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a1770980, transno 30064771464 00000100:00100000:2.0:1715205776.984061:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8800a6dedf00 x1798520456026176/t30064771472(30064771472) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205782 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00010000:00010000:0.0:1715205776.984063:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099173cc0/0xb608af4305004c48 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xec9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22991 expref: 93 pid: 14185 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715205776.984065:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a6dedf00, transno 30064771472 00000100:00100000:2.0:1715205776.984067:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8800a6de9300 x1798520456026112/t30064771473(30064771473) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205782 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.984072:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a6de9300, transno 30064771473 00010000:00010000:0.0:1715205776.984075:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a613600/0xb608af430500858a lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d95 expref: 92 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.984075:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8800a6de8000 x1798520456025856/t30064771474(30064771474) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205782 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.984078:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a6de8000, transno 30064771474 00000100:00100000:2.0:1715205776.984081:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8800a6de84c0 x1798520456026304/t30064771475(30064771475) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205782 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.984084:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a6de84c0, transno 30064771475 00000100:00100000:2.0:1715205776.984086:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8800a6de8e40 x1798520456026048/t30064771476(30064771476) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205782 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00010000:00010000:0.0:1715205776.984087:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59df80/0xb608af4305001a1b lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21a95 expref: 91 pid: 14186 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715205776.984089:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a6de8e40, transno 30064771476 00000100:00100000:2.0:1715205776.984092:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8800a6dee3c0 x1798520456026240/t30064771477(30064771477) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205782 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.984096:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a6dee3c0, transno 30064771477 00010000:00010000:0.0:1715205776.984097:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b880240/0xb608af4304ffe60b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b1b195 expref: 90 pid: 14307 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.984098:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8800a6de8980 x1798520456025920/t30064771478(30064771478) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205782 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-0-0.0' 00000004:00080000:2.0:1715205776.984101:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff8800a6de8980, transno 30064771478 00010000:00010000:0.0:1715205776.984107:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad680/0xb608af4305005689 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xebf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22ca1 expref: 89 pid: 14185 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715205776.984108:0:2851:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff88012f110980/1, rc -5, transno 0 00000004:00080000:2.0:1715205776.984108:0:17642:0:(osp_dev.c:1606:osp_import_event()) got inactive 00000100:00080000:2.0:1715205776.984110:0:17642:0:(pinger.c:414:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000004:00080000:3.0:1715205776.984110:0:2853:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff88012f112ac0/1, rc -5, transno 0 00000100:00100000:1.0:1715205776.984112:0:2851:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f110980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2851:1798520456044544:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1715205776.984114:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012f112ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2853:1798520456044416:0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1715205776.984117:0:17642:0:(import.c:86:import_set_state_nolock()) ffff88012f8a3800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1715205776.984118:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83c240/0xb608af4305003cf8 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xec5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b225a1 expref: 88 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.984122:0:17642:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d440000 pname:cluuid:pid:xid:nid:opc:job umount:lustre-MDT0000-mdtlov_UUID:17642:1798520456045056:0@lo:9:umount.0 00010000:00010000:0.0:1715205776.984128:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b881200/0xb608af4304ffe635 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xeb7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b1ab21 expref: 87 pid: 14307 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984137:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb586c0/0xb608af430500480b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xec8:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22825 expref: 86 pid: 14186 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.984140:0:17642:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715205776.984146:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a1c0/0xb608af43050081cb lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c29 expref: 85 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.984146:0:17642:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a6dddcc0 going to sleep for 5 seconds 00010000:00010000:0.0:1715205776.984156:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1b00/0xb608af4305006260 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0x1008:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230ad expref: 84 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984166:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9a400/0xb608af4304fff16b lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xec4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b20cb1 expref: 83 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984257:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c1440/0xb608af4305005c9b lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xec1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22eb5 expref: 82 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984274:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7594240/0xb608af43050059bc lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xec0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22db9 expref: 81 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984285:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59cd80/0xb608af4304ffe6c1 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeb8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b209bd expref: 80 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984294:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009af24480/0xb608af430500192d lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xecc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21a41 expref: 79 pid: 14185 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1715205776.984302:0:14218:0:(osp_sync.c:1126:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 0 in progress, 0 in flight, 62 done 00010000:00010000:0.0:1715205776.984304:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd998c0/0xb608af4305008211 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c45 expref: 78 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.984311:0:11776:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456045056 00010000:00010000:0.0:1715205776.984313:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091587180/0xb608af4305000de2 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xecf:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21651 expref: 77 pid: 14186 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984322:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009af25f80/0xb608af4304ffe906 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xec2:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b209d9 expref: 76 pid: 14869 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.984331:0:11776:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14713 00010000:00010000:0.0:1715205776.984332:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98d80/0xb608af4305008257 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x100c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c61 expref: 75 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.984334:0:11776:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d446880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+9:17642:x1798520456045056:12345-0@lo:9:umount.0 00010000:00010000:0.0:1715205776.984344:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedf180/0xb608af4305000c76 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xecc:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b215e1 expref: 74 pid: 14186 timeout: 0 lvb_type: 0 00000020:00000080:1.0:1715205776.984346:0:11776:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xb608af4304ffddc2 00000100:00080000:1.0:1715205776.984349:0:11776:0:(import.c:86:import_set_state_nolock()) ffff8800b4129800 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00010000:00010000:0.0:1715205776.984353:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2f40/0xb608af4305006cd9 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23465 expref: 73 pid: 14860 timeout: 0 lvb_type: 0 00000001:00000004:1.0:1715205776.984363:0:11776:0:(tgt_lastrcvd.c:705:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 7, last_transno is 30064771481 00010000:00010000:0.0:1715205776.984365:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170b40/0xb608af4305004151 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xec6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22665 expref: 72 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984374:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98b40/0xb608af43050006d4 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b213e9 expref: 71 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984382:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b881d40/0xb608af4304ffe604 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xec5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b1ad6d expref: 70 pid: 14307 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984394:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a7595200/0xb608af4305003f75 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b225f5 expref: 69 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984403:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3385f80/0xb608af4304fffdd5 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xeda:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b210f5 expref: 68 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984412:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd99440/0xb608af4305000cd8 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xece:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b215fd expref: 67 pid: 14186 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984421:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ac480/0xb608af43050083f4 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeec:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d02 expref: 66 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984432:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21440/0xb608af4305001877 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xecd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21a02 expref: 65 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984442:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a611f80/0xb608af430500856e lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d8e expref: 64 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984451:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d21d40/0xb608af4305005c39 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0x1004:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22e92 expref: 63 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984462:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb59d40/0xb608af43050063c5 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23116 expref: 62 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984474:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d23cc0/0xb608af4305001479 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xed6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21896 expref: 61 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984487:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800991733c0/0xb608af4305006ada lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2339a expref: 60 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984495:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83d680/0xb608af430500843a lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeee:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d1e expref: 59 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.984497:0:11776:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d446880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:17642:x1798520456045056:12345-0@lo:9:umount.0 Request processed in 163us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.984502:0:11776:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14713 00010000:00010000:0.0:1715205776.984505:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0d80/0xb608af43050047fd lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xec8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2281e expref: 58 pid: 14186 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.984512:0:6664:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205776.984517:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9f80/0xb608af4304fff753 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xed8:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b20ea2 expref: 57 pid: 14869 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984525:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800914898c0/0xb608af4304ffe9f4 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeb4:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b20a26 expref: 56 pid: 14869 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.984526:0:17642:0:(client.c:2892:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771478 gen 3 00000100:00100000:2.0:1715205776.984529:0:17642:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d440000 pname:cluuid:pid:xid:nid:opc:job umount:lustre-MDT0000-mdtlov_UUID:17642:1798520456045056:0@lo:9:umount.0 00010000:00010000:0.0:1715205776.984535:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad8000/0xb608af4305000625 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b213aa expref: 55 pid: 14185 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1715205776.984535:0:17642:0:(import.c:86:import_set_state_nolock()) ffff88012f8a3800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1715205776.984539:0:17642:0:(osp_dev.c:1590:osp_import_event()) got disconnected 00000004:00080000:2.0:1715205776.984540:0:17642:0:(osp_dev.c:1606:osp_import_event()) got inactive 00000100:00080000:2.0:1715205776.984541:0:17642:0:(import.c:157:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1715205776.984542:0:17642:0:(client.c:2892:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771478 gen 4 00010000:00010000:0.0:1715205776.984543:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c480/0xb608af4304ffe6a5 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeb7:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b209b6 expref: 54 pid: 14185 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715205776.984543:0:17642:0:(osp_dev.c:1606:osp_import_event()) got inactive 00000100:00100000:2.0:1715205776.984544:0:17642:0:(import.c:339:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1715205776.984554:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9200/0xb608af4305008480 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d3a expref: 53 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984565:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009af26880/0xb608af430500191f lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xecc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21a3a expref: 52 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984575:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb58900/0xb608af430500164e lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xed5:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2193e expref: 51 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984586:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59d200/0xb608af43050088b6 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ec2 expref: 50 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984599:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedc240/0xb608af430500762c lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1013:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237c2 expref: 49 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984610:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59ef40/0xb608af43050010a5 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xed0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21746 expref: 48 pid: 14186 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984638:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b882f40/0xb608af4304ffe63c lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xef6:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b1b546 expref: 47 pid: 14307 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984647:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9b00/0xb608af4304fff650 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b20e4e expref: 46 pid: 14869 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1715205776.984652:0:17642:0:(import.c:157:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1715205776.984656:0:17642:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@ffff8800a6decc00 x1798520456044160/t0(0) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205783 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'osp-syn-1-0.0' 00010000:00010000:0.0:1715205776.984658:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b882880/0xb608af4304ffe612 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xebe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b1ac4e expref: 45 pid: 14307 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.984665:0:17642:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@ffff8800a6deed40 x1798520456044224/t0(0) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205783 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'osp-syn-1-0.0' 00010000:00010000:0.0:1715205776.984668:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fada400/0xb608af43050084cd lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xef1:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d56 expref: 44 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.984671:0:17642:0:(client.c:3319:ptlrpc_abort_inflight()) @@@ inflight req@ffff8800a6ded580 x1798520456044288/t0(0) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205783 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'osp-syn-1-0.0' 00000004:00080000:3.0:1715205776.984674:0:2853:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff8800a6decc00/1, rc -5, transno 0 00000100:00100000:2.0:1715205776.984676:0:17642:0:(client.c:2892:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294970671 gen 3 00010000:00010000:0.0:1715205776.984677:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83f3c0/0xb608af43050088fc lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23ede expref: 43 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.984679:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88012d4450c0 x1798520456026368/t4294970694(4294970694) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205782 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-1-0.0' 00000100:00100000:3.0:1715205776.984680:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6decc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2853:1798520456044160:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1715205776.984684:0:2851:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff8800a6ded580/1, rc -5, transno 0 00000004:00080000:2.0:1715205776.984684:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88012d4450c0, transno 4294970694 00000100:00100000:1.0:1715205776.984687:0:2851:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6ded580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2851:1798520456044288:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1715205776.984687:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88009ce7ed40 x1798520456026560/t4294970695(4294970695) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205782 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-1-0.0' 00010000:00010000:0.0:1715205776.984689:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c0fc0/0xb608af4305006ccb lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2345e expref: 42 pid: 14860 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715205776.984691:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88009ce7ed40, transno 4294970695 00000100:00100000:2.0:1715205776.984694:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88012d444280 x1798520456026496/t4294970696(4294970696) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205782 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-1-0.0' 00010000:00010000:0.0:1715205776.984697:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eeddf80/0xb608af43050013ca lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xed4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2185e expref: 41 pid: 14185 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715205776.984699:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88012d444280, transno 4294970696 00000100:00100000:2.0:1715205776.984702:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88012d442ac0 x1798520456026432/t4294970697(4294970697) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205782 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-1-0.0' 00000004:00080000:2.0:1715205776.984706:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88012d442ac0, transno 4294970697 00010000:00010000:0.0:1715205776.984707:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009eedcfc0/0xb608af43050010f9 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xed1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21762 expref: 40 pid: 14186 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.984709:0:17642:0:(client.c:2912:ptlrpc_free_committed()) @@@ free request with old gen req@ffff88012d441300 x1798520456025984/t4294970698(4294970698) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1715205782 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-1-0.0' 00000004:00080000:2.0:1715205776.984712:0:17642:0:(osp_sync.c:509:osp_sync_request_commit_cb()) commit req ffff88012d441300, transno 4294970698 00010000:00010000:0.0:1715205776.984718:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b882ac0/0xb608af4304ffe5fd lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xecb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b1ae62 expref: 39 pid: 14307 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715205776.984718:0:17642:0:(osp_dev.c:1606:osp_import_event()) got inactive 00000100:00080000:2.0:1715205776.984719:0:17642:0:(pinger.c:414:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1715205776.984738:0:17642:0:(import.c:86:import_set_state_nolock()) ffff88009c6c3800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1715205776.984742:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3386ac0/0xb608af4304fffdc7 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeda:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b210ee expref: 38 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.984744:0:17642:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88012d440000 pname:cluuid:pid:xid:nid:opc:job umount:lustre-MDT0000-mdtlov_UUID:17642:1798520456045120:0@lo:9:umount.0 00010000:00010000:0.0:1715205776.984758:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59cb40/0xb608af430500828f lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c76 expref: 37 pid: 14860 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1715205776.984759:0:14223:0:(osp_sync.c:1126:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 1 in progress, 1 in flight, 5 done 00000100:00100000:2.0:1715205776.984760:0:17642:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1715205776.984767:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9ba80/0xb608af4305000cca lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xece:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b215f6 expref: 36 pid: 14186 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.984768:0:17642:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a6dddcc0 going to sleep for 5 seconds 00000100:00100000:1.0:1715205776.984773:0:11776:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520456045120 00000004:00080000:2.0:1715205776.984777:0:2854:0:(osp_sync.c:563:osp_sync_interpret()) reply req ffff8800a6deed40/1, rc -5, transno 0 00010000:00010000:0.0:1715205776.984778:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b881680/0xb608af4304ffe619 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xec2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b1acf6 expref: 35 pid: 14307 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.984781:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6deed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2854:1798520456044224:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1715205776.984787:0:11776:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14714 00010000:00010000:0.0:1715205776.984788:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59fcc0/0xb608af4305008942 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23efa expref: 34 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.984790:0:11776:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d4404c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+8:17642:x1798520456045120:12345-0@lo:9:umount.0 00010000:00010000:0.0:1715205776.984799:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fb5b840/0xb608af430500637f lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b230fa expref: 33 pid: 14185 timeout: 0 lvb_type: 0 00000020:00000080:1.0:1715205776.984800:0:11776:0:(genops.c:1442:class_disconnect()) disconnect: cookie 0xb608af4304ffddd0 00000100:00080000:1.0:1715205776.984804:0:11776:0:(import.c:86:import_set_state_nolock()) ffff880091eb3800 í¯Þÿÿÿÿÿÿÿÿÿÿÿÿ: changing import state from FULL to CLOSED 00010000:00010000:0.0:1715205776.984810:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091584240/0xb608af430500114d lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xed2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2177e expref: 32 pid: 14186 timeout: 0 lvb_type: 0 00000001:00000004:1.0:1715205776.984815:0:11776:0:(tgt_lastrcvd.c:705:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294970700 00010000:00010000:2.0:1715205776.984815:0:8314:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205776.984823:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a612d00/0xb608af4305008560 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d87 expref: 31 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984834:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800991706c0/0xb608af43050041d6 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xec6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2268f expref: 30 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984845:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98900/0xb608af4305000752 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef4:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21413 expref: 29 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984858:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a612f40/0xb608af43050038d0 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xedd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22497 expref: 28 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984869:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091489d40/0xb608af4305000eb4 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xecf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b21697 expref: 27 pid: 14186 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984880:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c2ac0/0xb608af43050044d8 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xec7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2271b expref: 26 pid: 14186 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984890:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fad9440/0xb608af4304fff745 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xed8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b20e9b expref: 25 pid: 14869 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984901:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73acd80/0xb608af430500885b lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e9f expref: 24 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984912:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b180/0xb608af43050011d2 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xed3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b217af expref: 23 pid: 14186 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984922:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98000/0xb608af430500078a lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2142f expref: 22 pid: 14186 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984935:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c900/0xb608af4304ffe689 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xeb6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b209af expref: 21 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.984940:0:11776:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4404c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:17642:x1798520456045120:12345-0@lo:9:umount.0 Request processed in 150us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.984944:0:11776:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14714 00010000:00010000:0.0:1715205776.984945:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c83e880/0xb608af43050081ee lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c37 expref: 20 pid: 14860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.984956:0:17642:0:(client.c:2892:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294970698 gen 3 00010000:00010000:0.0:1715205776.984957:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099171f80/0xb608af43050049e0 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xff9:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b228bf expref: 19 pid: 14185 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1715205776.984958:0:17642:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d440000 pname:cluuid:pid:xid:nid:opc:job umount:lustre-MDT0000-mdtlov_UUID:17642:1798520456045120:0@lo:9:umount.0 00000100:00080000:2.0:1715205776.984963:0:17642:0:(import.c:86:import_set_state_nolock()) ffff88009c6c3800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1715205776.984966:0:17642:0:(osp_dev.c:1590:osp_import_event()) got disconnected 00000004:00080000:2.0:1715205776.984967:0:17642:0:(osp_dev.c:1606:osp_import_event()) got inactive 00000100:00080000:2.0:1715205776.984967:0:17642:0:(import.c:157:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1715205776.984968:0:17642:0:(client.c:2892:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294970698 gen 4 00010000:00010000:0.0:1715205776.984969:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadba80/0xb608af4305000656 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b213bf expref: 18 pid: 14185 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1715205776.984970:0:17642:0:(osp_dev.c:1606:osp_import_event()) got inactive 00000100:00100000:2.0:1715205776.984971:0:17642:0:(import.c:339:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1715205776.984978:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099171b00/0xb608af4305006b43 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x100e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b233cb expref: 17 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984989:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fadb600/0xb608af43050084bf lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xef1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23d4f expref: 16 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.984999:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9b3c0/0xb608af4305008234 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23c53 expref: 15 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.985011:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd98480/0xb608af4305000c30 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xecb:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b215d3 expref: 14 pid: 14186 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.985022:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b883600/0xb608af4304ffe62e lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xeb8:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b1acd3 expref: 13 pid: 14307 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.985032:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b882640/0xb608af4304ffe627 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xed7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b1b053 expref: 12 pid: 14307 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.985043:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099170d80/0xb608af4305007664 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b237d7 expref: 11 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.985053:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c3180/0xb608af4305006cbd lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xee0:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23457 expref: 10 pid: 14860 timeout: 0 lvb_type: 0 00000020:00080000:2.0:1715205776.985058:0:17642:0:(genops.c:1530:class_disconnect_exports()) OBD device 5 (ffff88009cf03c90) has no exports 00010000:00010000:0.0:1715205776.985067:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b880fc0/0xb608af4304ffe643 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xeb5:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b1aadb expref: 9 pid: 14307 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.985078:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a73ad200/0xb608af43050087b3 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0x1014:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23e67 expref: 8 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.985090:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099171d40/0xb608af4305004bc3 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xec9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22967 expref: 7 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.985101:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8c21c0/0xb608af4305005475 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0x1000:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b22beb expref: 6 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.985112:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091584b40/0xb608af4305000ca7 lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xecd:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b215ef expref: 5 pid: 14186 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.985121:0:6665:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d233c0/0xb608af4305001869 lrc: 0/0,0 mode: --/PR res: [0x20001b1b3:0xecd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b219fb expref: 4 pid: 14185 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.985131:0:6665:0:(ldlm_lock.c:2662:ldlm_export_cancel_locks()) Export ffff88009c2b0800, canceled 122 locks, left on hash table 0. 00010000:00010000:0.0:1715205776.987742:0:6665:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305008965 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1715205776.987753:0:6665:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305008965 lrc: 4/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.987803:0:14860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305008965 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.987811:0:14860:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305008965 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1715205776.987841:0:14860:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20001b1b3:0xeea:0x0]: returning size 260096 00000004:00200000:1.0:1715205776.987844:0:14860:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1715205776.987856:0:14860:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305008965 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.987863:0:14860:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305008965 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1715205776.987869:0:17642:0:(ldlm_resource.c:1075:cleanup_resource()) ### setting FL_LOCAL_ONLY ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305008965 lrc: 3/1,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40316400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 00010000:00040000:2.0:1715205776.987875:0:17642:0:(ldlm_lockd.c:1007:ldlm_server_completion_ast()) ASSERTION( data != ((void *)0) ) failed: 00010000:00010000:1.0:1715205776.987883:0:14860:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59c6c0/0xb608af430500895e lrc: 0/0,0 mode: --/CR res: [0x20001b1b3:0xedf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23f08 expref: 4 pid: 14860 timeout: 0 lvb_type: 0 00010000:00020000:1.0:1715205776.987897:0:14860:0:(ldlm_lockd.c:1427:ldlm_handle_enqueue0()) ### lock on destroyed export ffff88009c2b0800 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305008965 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50306400000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23f08 expref: 3 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.987907:0:14860:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=-107) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b59f180/0xb608af4305008965 lrc: 4/0,0 mode: PR/PR res: [0x20001b1b3:0xeea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40306400000000 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23f08 expref: 3 pid: 14860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.987916:0:14860:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001b1b3:0xeea:0x0].0x0 (ffff88012e817a00) 00010000:00010000:1.0:1715205776.987918:0:14860:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1715205776.987920:0:14860:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88012b59f180, rc -107) 00000100:00080000:1.0:1715205776.987924:0:14860:0:(niobuf.c:609:ptlrpc_send_reply()) sending ENODEV from failed obd 5 00000100:00100000:1.0:1715205776.987957:0:14860:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f623dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+3:11754:x1798520455815296:12345-192.168.204.8@tcp:101:dbench.0 Request processed in 12614us (12647us total) trans 0 rc -19/-19 00000100:00100000:1.0:1715205776.987964:0:14860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 2147 00000100:00100000:1.0:1715205776.988115:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.988144:0:32666:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d443900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:32666:1798520456044608:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.988153:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1715205776.988160:0:32666:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091378900/0xb608af430500896c lrc: 3/0,1 mode: --/PW res: [0x15d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.988182:0:19961:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880134ad1300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:19961:1798520456044736:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.988192:0:19961:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a73ae1c0/0xb608af430500897a lrc: 3/0,1 mode: --/PW res: [0x15dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.988202:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.988207:0:2451:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009ce7bdc0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:2451:1798520456044992:192.168.204.8@tcp:104: 00000100:00100000:1.0:1715205776.988215:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1715205776.988215:0:2451:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a73ad8c0/0xb608af4305008996 lrc: 3/0,1 mode: --/PW res: [0x17b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.988228:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.988229:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455815552 00000100:00100000:1.0:1715205776.988241:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00010000:00010000:3.0:1715205776.988261:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bd99d40/0xb608af4305007227 lrc: 4/0,0 mode: PW/PW res: [0x15d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2363a expref: 46 pid: 19961 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.988274:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.8@tcp (source: 12345-192.168.204.8@tcp) 00000100:00100000:3.0:1715205776.988293:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455815488 00000100:00100000:1.0:1715205776.988300:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455815616 00010000:00010000:3.0:1715205776.988302:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009eedd8c0/0xb608af430500746c lrc: 5/0,0 mode: PW/PW res: [0x15da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23721 expref: 47 pid: 20898 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.988310:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c83c6c0/0xb608af4305007ead lrc: 4/0,0 mode: PW/PW res: [0x15dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b0a expref: 48 pid: 19961 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.988324:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455815680 00010000:00010000:1.0:1715205776.988331:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1d40/0xb608af4305006c3f lrc: 5/0,0 mode: PW/PW res: [0x17b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2342d expref: 42 pid: 19961 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.988340:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455815808 00000100:00100000:3.0:1715205776.988341:0:19709:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455815744 00010000:00010000:1.0:1715205776.988345:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800940caf40/0xb608af43050069ad lrc: 5/0,0 mode: PW/PW res: [0x17b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2334d expref: 43 pid: 19955 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.988352:0:8315:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1798520455815872 00010000:00010000:1.0:1715205776.988356:0:8315:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bd99b00/0xb608af43050073cb lrc: 4/0,0 mode: PW/PW res: [0x17b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236db expref: 44 pid: 19961 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.988365:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4896 00000100:00100000:1.0:1715205776.988369:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009274b900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+48:1830:x1798520455815552:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1715205776.988369:0:19709:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af4305007c7d lrc: 5/0,0 mode: PW/PW res: [0x17bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a31 expref: 45 pid: 20898 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.988378:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.988381:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bd99d40/0xb608af4305007227 lrc: 4/0,0 mode: PW/PW res: [0x15d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2363a expref: 48 pid: 19961 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.988387:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bd99d40/0xb608af4305007227 lrc: 3/0,0 mode: PW/PW res: [0x15d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2363a expref: 48 pid: 19961 timeout: 3136 lvb_type: 0 00000100:00100000:3.0:1715205776.988390:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4897 00000100:00100000:3.0:1715205776.988394:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a707d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+48:1831:x1798520455815616:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1715205776.988400:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.988401:0:8315:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bd99d40/0xb608af4305007227 lrc: 0/0,0 mode: --/PW res: [0x15d9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2363a expref: 48 pid: 19961 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.988402:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c83c6c0/0xb608af4305007ead lrc: 4/0,0 mode: PW/PW res: [0x15dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b0a expref: 48 pid: 19961 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.988411:0:8315:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205776.988412:0:8315:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205776.988414:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091378900/0xb608af430500896c lrc: 3/0,1 mode: PW/PW res: [0x15d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.988417:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c83c6c0/0xb608af4305007ead lrc: 3/0,0 mode: PW/PW res: [0x15dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b0a expref: 47 pid: 19961 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.988421:0:8315:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091378900/0xb608af430500896c lrc: 4/0,1 mode: PW/PW res: [0x15d9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.988429:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c83c6c0/0xb608af4305007ead lrc: 0/0,0 mode: --/PW res: [0x15dc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23b0a expref: 47 pid: 19961 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.988435:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205776.988449:0:19709:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205776.988451:0:19709:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1715205776.988452:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009274b900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+46:1830:x1798520455815552:12345-192.168.204.8@tcp:103:ldlm_bl_02.0 Request processed in 83us (338us total) trans 0 rc 0/0 00010000:00010000:3.0:1715205776.988452:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a73ae1c0/0xb608af430500897a lrc: 3/0,1 mode: PW/PW res: [0x15dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.988457:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4896 00010000:00010000:3.0:1715205776.988458:0:19709:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a73ae1c0/0xb608af430500897a lrc: 4/0,1 mode: PW/PW res: [0x15dc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.988468:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4898 00010000:00010000:3.0:1715205776.988470:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205776.988471:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092749c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+45:1830:x1798520455815488:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1715205776.988476:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.988479:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009eedd8c0/0xb608af430500746c lrc: 5/0,0 mode: PW/PW res: [0x15da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23721 expref: 45 pid: 20898 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.988486:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009eedd8c0/0xb608af430500746c lrc: 4/0,0 mode: PW/PW res: [0x15da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23721 expref: 45 pid: 20898 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.988495:0:8315:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205776.988496:0:8315:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205776.988498:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c83f840/0xb608af4305008973 lrc: 3/0,1 mode: PW/PW res: [0x15da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.988503:0:8315:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c83f840/0xb608af4305008973 lrc: 4/0,1 mode: PW/PW res: [0x15da:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 20898 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.988505:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a707d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+45:1831:x1798520455815616:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 98us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.988510:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4897 00010000:00010000:1.0:1715205776.988512:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1715205776.988524:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092749c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+44:1830:x1798520455815488:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 52us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.988536:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4899 00000100:00100000:1.0:1715205776.988540:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4898 00000100:00100000:3.0:1715205776.988541:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009274d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+45:1830:x1798520455815680:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1715205776.988547:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.988550:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1d40/0xb608af4305006c3f lrc: 5/0,0 mode: PW/PW res: [0x17b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2342d expref: 45 pid: 19961 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.988564:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1d40/0xb608af4305006c3f lrc: 4/0,0 mode: PW/PW res: [0x17b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2342d expref: 45 pid: 19961 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.988569:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4900 00000100:00100000:1.0:1715205776.988572:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009274d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+45:1830:x1798520455815808:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1715205776.988577:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.988580:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800940caf40/0xb608af43050069ad lrc: 5/0,0 mode: PW/PW res: [0x17b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2334d expref: 45 pid: 19955 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.988580:0:19709:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205776.988581:0:19709:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205776.988582:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c83cfc0/0xb608af4305008988 lrc: 3/0,1 mode: PW/PW res: [0x17b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.988586:0:19709:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c83cfc0/0xb608af4305008988 lrc: 4/0,1 mode: PW/PW res: [0x17b8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.988587:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800940caf40/0xb608af43050069ad lrc: 4/0,0 mode: PW/PW res: [0x17b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2334d expref: 45 pid: 19955 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.988591:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1715205776.988597:0:8315:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205776.988598:0:8315:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205776.988599:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b59c240/0xb608af430500898f lrc: 3/0,1 mode: PW/PW res: [0x17b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.988604:0:8315:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b59c240/0xb608af430500898f lrc: 4/0,1 mode: PW/PW res: [0x17b7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1715205776.988606:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009274d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+45:1830:x1798520455815680:12345-192.168.204.8@tcp:103:ldlm_bl_03.0 Request processed in 66us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.988609:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4899 00010000:00010000:1.0:1715205776.988612:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205776.988616:0:19709:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4901 00000100:00100000:1.0:1715205776.988640:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009274d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+44:1830:x1798520455815808:12345-192.168.204.8@tcp:103:ldlm_bl_04.0 Request processed in 68us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1715205776.988667:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4900 00000100:00100000:3.0:1715205776.988667:0:19709:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ef200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+44:1831:x1798520455815872:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1715205776.988677:0:8315:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.8@tcp, seq: 4902 00000100:00100000:1.0:1715205776.988681:0:8315:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009274a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+43:1831:x1798520455815744:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1715205776.988686:0:8315:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1715205776.988688:0:19709:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1715205776.988689:0:8315:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af4305007c7d lrc: 5/0,0 mode: PW/PW res: [0x17bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a31 expref: 43 pid: 20898 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.988691:0:19709:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bd99b00/0xb608af43050073cb lrc: 4/0,0 mode: PW/PW res: [0x17b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236db expref: 43 pid: 19961 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.988696:0:8315:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af4305007c7d lrc: 4/0,0 mode: PW/PW res: [0x17bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a31 expref: 43 pid: 20898 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.988698:0:19709:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bd99b00/0xb608af43050073cb lrc: 3/0,0 mode: PW/PW res: [0x17b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236db expref: 43 pid: 19961 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.988707:0:8315:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205776.988708:0:8315:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1715205776.988709:0:8315:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b59c000/0xb608af4305008981 lrc: 3/0,1 mode: PW/PW res: [0x17bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.988714:0:8315:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b59c000/0xb608af4305008981 lrc: 4/0,1 mode: PW/PW res: [0x17bb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.988720:0:19709:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bd99b00/0xb608af43050073cb lrc: 0/0,0 mode: --/PW res: [0x17b9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b236db expref: 43 pid: 19961 timeout: 3136 lvb_type: 0 00010000:00010000:1.0:1715205776.988740:0:8315:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1715205776.988750:0:19709:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1715205776.988752:0:19709:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1715205776.988753:0:8315:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009274a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+42:1831:x1798520455815744:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 71us (511us total) trans 0 rc 0/0 00010000:00010000:3.0:1715205776.988753:0:19709:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a73ad8c0/0xb608af4305008996 lrc: 3/0,1 mode: PW/PW res: [0x17b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 2451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.988757:0:8315:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4902 00010000:00010000:3.0:1715205776.988758:0:19709:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a73ad8c0/0xb608af4305008996 lrc: 4/0,1 mode: PW/PW res: [0x17b9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 2451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.988776:0:19709:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1715205776.988790:0:19709:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ef200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:41bc1ae4-4825-48bc-b22e-9cbe8affc36b+41:1831:x1798520455815872:12345-192.168.204.8@tcp:103:ldlm_bl_01.0 Request processed in 123us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1715205776.988795:0:19709:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.8@tcp, seq: 4901 00010000:00010000:3.0:1715205776.988842:0:2451:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a73ad8c0/0xb608af4305008996 lrc: 3/0,1 mode: PW/PW res: [0x17b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.988856:0:11773:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800940caf40/0xb608af43050069ad lrc: 0/0,0 mode: --/PW res: [0x17b7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2334d expref: 40 pid: 19955 timeout: 3136 lvb_type: 0 00010000:00010000:3.0:1715205776.988860:0:2451:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a73ad8c0/0xb608af4305008996 lrc: 3/0,1 mode: PW/PW res: [0x17b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2451 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1715205776.988865:0:11773:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009274f6c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:11773:1798520456044928:192.168.204.8@tcp:104: 00010000:00010000:3.0:1715205776.988866:0:2451:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a73ad8c0/0xb608af4305008996 lrc: 3/0,1 mode: PW/PW res: [0x17b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 2451 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.988873:0:2451:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a73ad8c0/0xb608af4305008996 lrc: 2/0,0 mode: PW/PW res: [0x17b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 2451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.988874:0:11773:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012b59c240/0xb608af430500898f lrc: 3/0,1 mode: PW/PW res: [0x17b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.988878:0:11773:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012b59c240/0xb608af430500898f lrc: 3/0,1 mode: PW/PW res: [0x17b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.988882:0:11773:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b59c240/0xb608af430500898f lrc: 3/0,1 mode: PW/PW res: [0x17b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.988883:0:2451:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1715205776.988887:0:11773:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b59c240/0xb608af430500898f lrc: 3/0,1 mode: PW/PW res: [0x17b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.988891:0:11773:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b59c240/0xb608af430500898f lrc: 2/0,0 mode: PW/PW res: [0x17b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.988901:0:11773:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1715205776.988916:0:19961:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a73ae1c0/0xb608af430500897a lrc: 3/0,1 mode: PW/PW res: [0x15dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.988926:0:19961:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a73ae1c0/0xb608af430500897a lrc: 3/0,1 mode: PW/PW res: [0x15dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.988931:0:19961:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a73ae1c0/0xb608af430500897a lrc: 3/0,1 mode: PW/PW res: [0x15dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.988935:0:19961:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a73ae1c0/0xb608af430500897a lrc: 2/0,0 mode: PW/PW res: [0x15dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.988957:0:19961:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1715205776.989102:0:6569:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1715205776.989105:0:6569:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a73ad8c0/0xb608af4305008996 lrc: 2/0,0 mode: PW/PW res: [0x17b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 2451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989111:0:6569:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ad8c0 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:1.0:1715205776.989114:0:6569:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a73ad8c0/0xb608af4305008996 lrc: 2/0,0 mode: PW/PW res: [0x17b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 2451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989120:0:6569:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a73ad8c0/0xb608af4305008996 lrc: 3/0,0 mode: PW/PW res: [0x17b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 2451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989129:0:6569:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a73ad8c0/0xb608af4305008996 lrc: 1/0,0 mode: --/PW res: [0x17b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 2451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989133:0:6569:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a73ad8c0/0xb608af4305008996 lrc: 0/0,0 mode: --/PW res: [0x17b9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 2451 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989149:0:6569:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1715205776.989150:0:6569:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b59c240/0xb608af430500898f lrc: 2/0,0 mode: PW/PW res: [0x17b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989154:0:6569:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59c240 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:1.0:1715205776.989156:0:6569:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b59c240/0xb608af430500898f lrc: 2/0,0 mode: PW/PW res: [0x17b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989160:0:6569:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b59c240/0xb608af430500898f lrc: 3/0,0 mode: PW/PW res: [0x17b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989165:0:6569:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b59c240/0xb608af430500898f lrc: 1/0,0 mode: --/PW res: [0x17b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989168:0:6569:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b59c240/0xb608af430500898f lrc: 0/0,0 mode: --/PW res: [0x17b7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11773 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989179:0:6569:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715205776.989180:0:6569:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a73ae1c0/0xb608af430500897a lrc: 2/0,0 mode: PW/PW res: [0x15dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989184:0:6569:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a73ae1c0 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:1.0:1715205776.989185:0:6569:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a73ae1c0/0xb608af430500897a lrc: 2/0,0 mode: PW/PW res: [0x15dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989189:0:6569:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a73ae1c0/0xb608af430500897a lrc: 3/0,0 mode: PW/PW res: [0x15dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989195:0:6569:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a73ae1c0/0xb608af430500897a lrc: 1/0,0 mode: --/PW res: [0x15dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989199:0:6569:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a73ae1c0/0xb608af430500897a lrc: 0/0,0 mode: --/PW res: [0x15dc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19961 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989209:0:6569:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205776.989210:0:6569:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205776.989210:0:6569:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205776.989214:0:11161:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205776.989227:0:8300:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a73adf80/0xb608af4305007c7d lrc: 0/0,0 mode: --/PW res: [0x17bb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23a31 expref: 39 pid: 20898 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.989233:0:8300:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88012d4c2ac0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8300:1798520456044800:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.989244:0:8300:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012b59c000/0xb608af4305008981 lrc: 3/0,1 mode: PW/PW res: [0x17bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989248:0:8300:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012b59c000/0xb608af4305008981 lrc: 3/0,1 mode: PW/PW res: [0x17bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989252:0:8300:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b59c000/0xb608af4305008981 lrc: 3/0,1 mode: PW/PW res: [0x17bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.989253:0:6664:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205776.989256:0:8300:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b59c000/0xb608af4305008981 lrc: 3/0,1 mode: PW/PW res: [0x17bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989260:0:8300:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b59c000/0xb608af4305008981 lrc: 2/0,0 mode: PW/PW res: [0x17bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989269:0:8300:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1715205776.989299:0:8314:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715205776.989301:0:8314:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b59c000/0xb608af4305008981 lrc: 2/0,0 mode: PW/PW res: [0x17bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989306:0:8314:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012b59c000 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:1.0:1715205776.989307:0:8314:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b59c000/0xb608af4305008981 lrc: 2/0,0 mode: PW/PW res: [0x17bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989311:0:8314:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b59c000/0xb608af4305008981 lrc: 3/0,0 mode: PW/PW res: [0x17bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989318:0:8314:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b59c000/0xb608af4305008981 lrc: 1/0,0 mode: --/PW res: [0x17bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989323:0:8314:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b59c000/0xb608af4305008981 lrc: 0/0,0 mode: --/PW res: [0x17bb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8300 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.989330:0:32666:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091378900/0xb608af430500896c lrc: 3/0,1 mode: PW/PW res: [0x15d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989336:0:8314:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715205776.989336:0:32666:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091378900/0xb608af430500896c lrc: 3/0,1 mode: PW/PW res: [0x15d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989337:0:8314:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205776.989337:0:8314:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1715205776.989341:0:32666:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091378900/0xb608af430500896c lrc: 3/0,1 mode: PW/PW res: [0x15d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.989345:0:32666:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091378900/0xb608af430500896c lrc: 2/0,0 mode: PW/PW res: [0x15d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1715205776.989353:0:32666:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1715205776.989447:0:6569:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715205776.989450:0:6569:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091378900/0xb608af430500896c lrc: 2/0,0 mode: PW/PW res: [0x15d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989455:0:6569:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880091378900 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:1.0:1715205776.989457:0:6569:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091378900/0xb608af430500896c lrc: 2/0,0 mode: PW/PW res: [0x15d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989462:0:6569:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091378900/0xb608af430500896c lrc: 3/0,0 mode: PW/PW res: [0x15d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989471:0:6569:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091378900/0xb608af430500896c lrc: 1/0,0 mode: --/PW res: [0x15d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989475:0:6569:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091378900/0xb608af430500896c lrc: 0/0,0 mode: --/PW res: [0x15d9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32666 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989486:0:6569:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205776.989487:0:6569:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205776.989488:0:6569:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205776.989694:0:32645:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b8c1d40/0xb608af4305006c3f lrc: 0/0,0 mode: --/PW res: [0x17b8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b2342d expref: 38 pid: 19961 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.989704:0:32645:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009f624740 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:32645:1798520456044864:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.989713:0:32645:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c83cfc0/0xb608af4305008988 lrc: 3/0,1 mode: PW/PW res: [0x17b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989719:0:32645:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c83cfc0/0xb608af4305008988 lrc: 3/0,1 mode: PW/PW res: [0x17b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989736:0:32645:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c83cfc0/0xb608af4305008988 lrc: 3/0,1 mode: PW/PW res: [0x17b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989741:0:32645:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c83cfc0/0xb608af4305008988 lrc: 3/0,1 mode: PW/PW res: [0x17b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989747:0:32645:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c83cfc0/0xb608af4305008988 lrc: 2/0,0 mode: PW/PW res: [0x17b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989755:0:32645:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1715205776.989904:0:11161:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715205776.989907:0:11161:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c83cfc0/0xb608af4305008988 lrc: 2/0,0 mode: PW/PW res: [0x17b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989912:0:11161:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83cfc0 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:1.0:1715205776.989913:0:11161:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c83cfc0/0xb608af4305008988 lrc: 2/0,0 mode: PW/PW res: [0x17b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989918:0:11161:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c83cfc0/0xb608af4305008988 lrc: 3/0,0 mode: PW/PW res: [0x17b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989926:0:11161:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c83cfc0/0xb608af4305008988 lrc: 1/0,0 mode: --/PW res: [0x17b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989931:0:11161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c83cfc0/0xb608af4305008988 lrc: 0/0,0 mode: --/PW res: [0x17b8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989940:0:11161:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205776.989941:0:11161:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205776.989942:0:11161:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205776.989957:0:20898:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009eedd8c0/0xb608af430500746c lrc: 0/0,0 mode: --/PW res: [0x15da:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.204.8@tcp remote: 0xd00cff7d5b23721 expref: 43 pid: 20898 timeout: 3136 lvb_type: 0 00000100:00100000:1.0:1715205776.989968:0:20898:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009f6217c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:20898:1798520456044672:192.168.204.8@tcp:104: 00010000:00010000:1.0:1715205776.989975:0:20898:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c83f840/0xb608af4305008973 lrc: 3/0,1 mode: PW/PW res: [0x15da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989980:0:20898:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c83f840/0xb608af4305008973 lrc: 3/0,1 mode: PW/PW res: [0x15da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989984:0:20898:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c83f840/0xb608af4305008973 lrc: 3/0,1 mode: PW/PW res: [0x15da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989989:0:20898:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c83f840/0xb608af4305008973 lrc: 3/0,1 mode: PW/PW res: [0x15da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.989993:0:20898:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c83f840/0xb608af4305008973 lrc: 2/0,0 mode: PW/PW res: [0x15da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.990002:0:20898:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1715205776.990034:0:6664:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1715205776.990037:0:6664:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c83f840/0xb608af4305008973 lrc: 2/0,0 mode: PW/PW res: [0x15da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.990042:0:6664:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88012c83f840 already unused, calling callback (ffffffffa07ff190) 00010000:00010000:1.0:1715205776.990043:0:6664:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c83f840/0xb608af4305008973 lrc: 2/0,0 mode: PW/PW res: [0x15da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.990048:0:6664:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c83f840/0xb608af4305008973 lrc: 3/0,0 mode: PW/PW res: [0x15da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.990058:0:6664:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c83f840/0xb608af4305008973 lrc: 1/0,0 mode: --/PW res: [0x15da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.990062:0:6664:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c83f840/0xb608af4305008973 lrc: 0/0,0 mode: --/PW res: [0x15da:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20898 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1715205776.990073:0:6664:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205776.990074:0:6664:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1715205776.990075:0:6664:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205776.998233:0:6665:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205776.998236:0:6665:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1715205776.998239:0:6665:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00040000:2.0:1715205777.012503:0:17642:0:(ldlm_lockd.c:1007:ldlm_server_completion_ast()) LBUG 00000001:00080000:1.0:1715205777.013301:0:24534:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0000: transno 30064771483 is committed 00000001:00100000:1.0:1715205777.013312:0:24534:0:(tgt_lastrcvd.c:541:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1715205777.013317:0:24534:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0000: transno 30064771484 is committed 00000400:00000100:3.0:1715205777.013367:0:2451:0:(lib-move.c:4238:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 4 match 1798520456044480 offset 224 length 432: 4 00000100:00100000:3.0:1715205777.013381:0:2451:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad4c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:2853:x1798520456044480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30094us (30136us total) trans 30064771484 rc 0/0 00000400:00000100:1.0:1715205777.013385:0:11773:0:(lib-move.c:4238:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 4 match 1798520456044416 offset 224 length 432: 4 00000100:00100000:1.0:1715205777.013391:0:11773:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ad63c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:2853:x1798520456044416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30113us (30176us total) trans 30064771482 rc 0/0 00000100:00100000:3.0:1715205777.013392:0:2451:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14712 00000100:00100000:1.0:1715205777.013395:0:11773:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14711 00000400:00000100:1.0:1715205777.013454:0:8300:0:(lib-move.c:4238:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 4 match 1798520456044544 offset 224 length 432: 4 00000100:00100000:1.0:1715205777.013459:0:8300:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f115580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+3:2851:x1798520456044544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30284us (30354us total) trans 30064771483 rc 0/0 00000100:00100000:1.0:1715205777.013463:0:8300:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14709 00000001:00080000:0.0:1715205777.023834:0:10032:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0001: transno 4294970703 is committed 00000001:00100000:0.0:1715205777.023848:0:10032:0:(tgt_lastrcvd.c:541:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000400:00000100:1.0:1715205777.023886:0:20898:0:(lib-move.c:4238:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 4 match 1798520456044160 offset 224 length 432: 4 00000100:00100000:1.0:1715205777.023902:0:20898:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910e84c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+3:2853:x1798520456044160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 40836us (40901us total) trans 4294970703 rc 0/0 00000100:00100000:1.0:1715205777.023909:0:20898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14706 00000400:00000100:3.0:1715205777.023919:0:19961:0:(lib-move.c:4238:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 4 match 1798520456044288 offset 224 length 432: 4 00000100:00100000:3.0:1715205777.023925:0:19961:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6deda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2:2851:x1798520456044288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 40852us (40905us total) trans 4294970701 rc 0/0 00000100:00100000:3.0:1715205777.023929:0:19961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14707 00000400:00000100:3.0:1715205777.023962:0:32666:0:(lib-move.c:4238:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 4 match 1798520456044224 offset 224 length 432: 4 00000100:00100000:3.0:1715205777.023966:0:32666:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d445a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+1:2854:x1798520456044224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 40890us (40928us total) trans 4294970702 rc 0/0 00000100:00100000:3.0:1715205777.023970:0:32666:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14708 00000020:00000080:3.0:1715205777.023977:0:32666:0:(genops.c:985:class_export_put()) final put ffff880091eb7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1715205777.023990:0:14676:0:(genops.c:944:class_export_destroy()) destroying export ffff880091eb7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1715205777.024016:0:14676:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff880091eb3800 for lustre-OST0001 00000400:00000100:1.0:1715205777.033956:0:32645:0:(lib-move.c:4238:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 4 match 1798520456044352 offset 224 length 432: 4 00000100:00100000:1.0:1715205777.033974:0:32645:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d4c76c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+2:2851:x1798520456044352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50778us (50837us total) trans 30064771485 rc 0/0 00000100:00100000:1.0:1715205777.033983:0:32645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14710 00000001:00080000:1.0:1715205777.034011:0:24534:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-OST0000: transno 30064771485 is committed 00000020:00000080:1.0:1715205777.034014:0:24534:0:(genops.c:985:class_export_put()) final put ffff8800b412c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1715205777.034151:0:14676:0:(genops.c:944:class_export_destroy()) destroying export ffff8800b412c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1715205777.034218:0:14676:0:(genops.c:1164:obd_zombie_import_free()) destroying import ffff8800b4129800 for lustre-OST0000 Debug log: 23498 lines, 23498 kept, 0 dropped, 0 bad.